DOCUMENT RESUHE 



ED 163 967 

AUTHOR 
TITLE 



IE 0p6 633 



-INSTITUTION 
S£\ONS AGENCY 
PUB DATE 

^NQTE 



EDRS PRICE _ 
ESCEIPTORS 



IDENTIFIERS 




Auster, Ethel; Lawtonw Stephen R. 
Educational Information. System for Ontario. Interim 
Report, March 1975- February 1976\^ -< "* 
Ontario Inst, fpr Studies in Education, Toronto. 
Ontario Dept. of Education, Toronto.- 
76 * 

251p.; For related documents, see IR 006 633-635 
HF-S0.83 HC-S14.05 Plus Postage. 

Annotated Bibliographies; *Educational Resources; 
Evaluation; Expenditures; information Dissemination; 
* Information Systems; On Line systems; Organization; 
Questionnaires; Records (Forms); Systems Approach; 
Talles (Data) ; Training; *Use Studies 
♦Educational information system for Ontario. 



ABSTRACT- v 

This interim 'report of the RJSO project concentrates 
on the early phases of the project responsible for the operation of 
an online bibliographic search service for educators in, Ontario. 
Implementation' of services involved providing access to data base^ 
maintained by SDC "and Lockheed through a terminal located in the 
Ontario Institute for Studies in* Education s (OISE) Library: making 
available copies of documents cited in computer generated 
bibliographies; and training consultants to help clarify and >- 
negotiate requests from users in 'the North Bay area of Ontario. This 
report reviews relevant literature on information centers, 
intermediaries, and changes in education, and describes the social 
effects of integrating EISO intcolSE. The training program for 
Educational Information Consultants is evaluated. The. business 
systems, designed to account for the financial aspects of the 
service, are outlined, and an actual user »s .experience negotiating a 
search request is provided. The -theoretical models utilized in EISO»s 
set-up- are outlined in detail. Data collected for user studies are 
included together with preliminary findings. Appendices include" 
sample time lines, job descriptions, data collection instruments, 
business forms, publicity items,- and pro ject /training programs. 
(Author/ttBR) 
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Early in 1975,'Uhe Ontario Ministry pf^E duration cbntracted with Thp 
Ontario Institute for Studies in Education to undertake a research project to 
examine" the viability of operating an on-line bibliographic search service for 
t}ie educators of tM&« province. The project was.to -stuiry, r afnc)hg others, .the* 
nature and levels of demand in Ontario for such a service; tp^deyelop and 
refine methods of placing search orders, order delivery, .arid advertising; 
to determine manpower, technical requirements and fiscal viability; and to 

sCSsess the effectiveness of an intermediary in interacting with users in a * 

■ " * . * . . \ 

* remote geographic setting in Northern Ontario. v 

" * v \ 

The earliest phases cOf the project involved imp*— station of the 

; search service. Access\to the data bases maintained by System Develop- 

*•* - 

ment' Corporation and Lockheed, Coth in California, was provided bjr a O 
terminal located in the OISE Library. Copies of * documents cited in computer 

9 

generated bibliographies were made- available for requestors in microfiche * 

or hard copy formats. TSTdacational Information Consultants were trained: to . 

j * ■ • - 1 

help" clarify and negotiate requests from users in-j.the Nortn Bay area of 
Ontario.. , • r * 'V. , 

A systems model is usegl to organize the multitude of factors that are^ 
relevant to this study. '■ The search service is analyzed in terms of input, . 
process, and output variables. At each stage, sociological, psycfiblogical, 
and economic characteristics of the users, analyst and service are ex amine d. 
The entire framework is considered within an adoption of innovations model. 



This interim report, written five months after EISO was fully opera- 
tional, concentrates on the early phases of the project. The relevant litera- 
ture on information centres,' intermediaries, and change in education is 
reviewed; -the social effects of integrating EISO into OISE are describeji; ^ 

the training programme for the^ Educational Inf oi^mation Consultants is evalu— 

• ' . \ * ^ - ' - 

ated; the business"system^ designe(|p:^^^ aspects of 

the service are outlined arid an actual user f s experience negotiating a search > 

request is provided. The latter ^chapters of the report outline in consi.- able 

* ' • ' ' * . ■ A ■ ' ' 

detail the theoretical models used and provide the context for the collection # 
and analysis of /the' data. Dat^ collected are briefly described and preliminary 
findings presented. Extensive appendices give samples of the time-line, 
job description, data collection instruments, business forms, publicity 
items, an<^ training programmes of the project. " ? 
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Introduction 



It is hy now apparent to. both educators and information scientists that 
We are in the midst of, a rapidly changing environment with regard to information 
delivery requirements and techniques. Generous public and private spending *> t 
on education in the recent past resulted in the production of massive amounts 
of information in the form of published and especially unpublished literature, 
such as reports, research studies, curriculum materials, proceedings, papers, 
and other documents. This store- of knowledge, however, remained and con— 
tinues to remain virtually inaccessible to the many practitioners in the field. \. 
Problems of dissemination and utilization have focussecl around the lack of 
effective and efficient technology to transfer this* information, and around the 
lack of individuals sufficiently knowledgeable to act. as "knowledge linkers" 
between the research producers and the research user £ — the local educators. 
Not withdUt cause, public pressi|5j£ has mounted to curbNthe irate of increase 
in educational spending and to justify the^use of large sums allocat^c^in the past. 

It is in response to these and oth^r circumstances and pressures, that 
the Ontario Ministry of Education contracted with The Ontario Institute for 
Studies in Education to undertake -a study that would ^hed l|ght.on some of the 
issues and problems of information dissemination and utilization. Prior to thef^ 
creation of the Educational Inf or nt&tion System for Ontario (EISO), no computer — : 
based, on-line bibliographic search service -aimed primarily at educators 



existed in this province. Nor did there at that time, nor does there yet, exist 
a database consisting of entirely Canadian educational materials or documents. 
Obviously, then, if serious study was to be Undertaken preliminary to the pos- 
^sible creation of any such provincial or national system, at least two areas » - 

- . would have-to- be explored and data colle cted and analyzed before -any f ur ther 

progress could be made. ..One of these areas was the technical requirements 
-and feasibility of creating an Ontario data base of educational information. To 
examine this highly complex aspect of information storage and retrieval, the 
Ontario Ministry of Education contracted with the Metropolitan School Board of 
Toronto to undertake a project entitled Ontario Educational Research Informa- 
tion System (ONTERIS) . To. look into the questions of dissemination and utili- 
zation of information, the Ministry funded EISO. - Since there was neither a 

""■©^adian educational data base nor Jji search sefrvifce to study, EISO set up a 
fully operational information service offering an interactive on-line bibliographic 
search -service to the educators of this province by providing access to the 
existing ERIC data base. From the very first, then, EISO differed "from the 
usual research contract in that it was not only "to provide a rigorous research 
study firmly grounded in theoretical concepts, but it was alsd to have, a large 
developmeiital component in the implementation -<?f a search service available 
to educators on. a co^t -recover^ basis. Thus not only would such normal aspects- 
of contract research as research design, data collection and analysis have to 

be undertaken, but also some other more unusual activities would be demanded 

by the unique dimensions of the contract (see Appendix A)t a business system 

would have to be established for the fee-based service, a publicity andadver- 

• . ' . v . 

tising campaign would haye to be launched to create awareness of - the service 

./ v . " " ■ . - ft 

among educators, a training programme would. liave to be established to train 
Educational Information Consultants who^were to act as information inter- 
mediaries in geographically remote. areas. Professional development activities, 
seminars, workshops, and Educational Information Stations added still other / 
aspects to the study. The earlier phases of the project (see Time Line, 



■A 

'Appendix B), however, revolved around 4 setting up the search service whose 
operation and use was to be studied/ In addition to the Principal Investigators, 
an experienced staff was hired consisting of *a search analyst who would negotiate 
' information requests and operate the computer terminal, a research officer, 

and a library assistant". The search service was located in the OISEBibrary 

adjacent to the ERIC microfiche- collection and ZA *r, indexes. * 

The service provide^ by the Educational Information System for Ontario 
project assists educators in locating and duplicatiu^ materials contained in the 
collection of the Educational Resources Information Center (ERIC). (Comprised * 
of 16 subjtect-specialized clearinghouses, ERIC is an information gathering and 
disseminating network operating under the auspices of the U. S. National Insti- 
tuU. education. J^jke clearinghouses collect,' index," and abstract research * 
reports, conference papers, curriculum materials, including many from 
Canadian sources, and announce them monthly in Resources in Education (RIE) . 
They also index; more than YpO jqurnals, including 26 from Canada, for Current 
Index to Journals in Education (CUE) . In all, the ERIC data base includes over 
200, 000 references, to which almost 2, 500 new references are added each jmonth. 
The EISO service provides inters rive, on-line computer access to the ERIC 
data base via -a terminal located in the OISE Library. " 
v * To use the search service, the educator submits HTs^tnftJfrnation request 

to the search analyst, a specially trained reference librarian^ who rewords 
the content to confer ~n to a list of subject headings designed for computer 
scanning of the EJRIC data base. The search analyst queries the data^stored in 



i 



a computer operated by System Development Corporation in Santa Monica, 
California- When combinations of subject headings are entered, the number of 
relevant eitatiqns and sample citations are printed on-line . If the citations are 
appropriate, a bibliography containing the complete set of references aridjgp 
abstracts is printed off-line in Santa Monica and mailed directly to the requestor. 

^ Should the requestor wish to obtain copies of the original documents 
citedjjttlilie bibliography he may order documents available on a microfiche and 

* v > 
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paper copies of journal articles from EISO. Paper copies of fiche are available 
from ERIC Document Reproduction Service, Complete order information is 
sent to users after thei^ s'earch has been completed. 

This service is seen as- being especially helpful to those preparing 
reports, papers,- speeches, proposals 7 — to those seeking alternative solutions^ — N ~ 



"ic- 



tO problems; and tbr those working under pressure of deadlines. 
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rf ' ^ A * CHAPTER II * - . ■ ^ 

-* <? \ * ■. - ■ . . ^ ' 

Information Centres,' /Intermediaries, and Change • 

' in Education-: A^eview. of the literature S. ■"■ 



* • The numerous and diverse specifications of the Ontario Ministry of. v . 
Education contract entitled V Educational* Information System for Ontario" are ' 
grounded in several separate research traditions tkat fall within the socials 
s'cience disciplines of information science and education. . The. setting up of 
an automated bibliographical search, service to provide on-line access to ERIC 
materials to the province's educators through a terminal housed in the PISE 
Library can be seen as a modern extension of the information services special 
libraries have provided for decades. The study of the use of the service and 
its effectiveness stem from the tradition of user studies and information system 

v eval uati on that have been the major concerns of information scientists in recent 
years. The role of the intermediary in interpreting and transmitting informa- 
tion has evolved from the concept of the agricultural extension agent prevalent 

_ in the, U.S. at the turn of the century, while the introduction of this essentially 
. new service and mode of obtaining information must be seen in the context of 
the research carried out on the planning of change and the adoption and diffusion 

. of innovative practices in education. This brief introduction canfiot hope to 
examine each of these traditions in detail. A number of .extensive bibliographies, 

•., however, have been, compiled and provide valuable guides to the literature. .* . * 
Among the most helpful "is the 4000 item compilation, JKnbwledge Utilization 



aitei Disse™™**ibn (Havfelock, 197^), which views the flow ok knowledge as a 
process involving a sender who communicates knowledge over a period of time 

-to satisfy the needs of a receiver in a -specific geographic location through a 
variety of mechanising or strategies such as informal contacts; conferences, 
ancF publications. The effect of these -efEdrt^ feeds back into the cycle to modify 
and improve it. It is important to grasp eacji of these cqmponent^ - as separate fc 
variables each of which may be investigated in-depthl^a its own right or in com- 
bination with the other variables ^nd^related to a variety of subject areas such 
as education, agriculture, law, technology, social welfare, etc. The Havelock 
bibliography covers not only the,se areas from 1967 to 1972, but also treats 

'the support systems needed for knowledge flow: institutions, that fund, tr^airr, 

m recruit, control, protect, or plan dissemination and utilization of information. 
The -more technical aspects of information retrieval systems are treated in the 
somewhat dated but still valuable bibliography Evaluation of Information 

" Systems : A Selected Bibliography with Information Abstracts (Henderson, 3.967) # 
Although many changes have occurred in the field since this publication was 
issued, its entries represent the discussion of the growth problems of informa- 
tion systems that are now of concern to Canadian specialists. The latest 

o- 

trends in this field may be followed through the Annual Be view of Information 
Science and Technology (Cuadra, annual), which from 1-966* to the present has 
presented chapters devoted to state-of-the-art surveys *pf major issues. The 
topic of change in education has received much attention. A concise biblio- 
graphic essay that presents the major scholarly positions ^for school administra- 
tors is entitled Observations and Analysis of the Literature on Chaftge' (Maguire, 
1 970) . A more comprehensive listing is available in An Annotated ^Kliography 
on Administering for Change,, (Maguire et al. , ±971): This>aiiay be supplemented 
fey Volume II o^ the Or^on Studies (Schalock, 1972) which presents a 642. page 
compendium hi -the scholarly literature that describes research, development, 
diffusion, and evaluation activities. The literature of the adoption and diffusion 
of innovations is* comprehensively covered by Communication of Innovations 



(Rogers and Shoemaker, 1971), .which synthesizes and analyzes -over 1500 - 
relevant^ studies. * ' ^ |. * 

^ * The annotated bibliography at the end of this report reflects the major 
theoretical arid practical concerns of the Ontario Ministry^ of Education contract. 

Part A' treats those works on change and innovation that will shed /light on the" 

I ^ ■ ' r .... . . z ' - ^] . . 

aspects of an educational information system which derive mainly from the 
education literature.. Emphasis has been placed on the major theoretical 
contributors to the field with a few examples of practical implementations. 
Part B describes the -use of ERIC by schools in the U.S. Often this use has 
had to be inferred since; no service run exclusively by or for school boards 
could be found. Indeed, identification pf literature showing use of ERIQ as a, 
.specific <Jata base by schools-is made difficult because Tr ERIC^ T *as an identify- 
ing or descriptive term was jiot used consistently in Research iw Education 
until 1^72. However", examples of services "provided "by intermediate units, 
such as state and local education agencies^ have been included to shed light 
on level of requests, pricing structures, spiffing, and administration of similar* 
services where possible. Part C draws upon the literature of librarians!} ip 
and information science to illustrate those is^EFfei^and concerns that should be 
considered in setting up an information service. The material is generally 
current, conflicting, and of limited applicability. This is not surprising ill a 
field /which is still new and seeking common standards and a shared philosophy. 

The first part of this annotated bibliography deals with, chang^and in- 
novation in education, and it is 'to this topic that we. now turn. It woulo^seem , 
reasonable to suppose that a general overview of the innovative process would 
b4 useful to those interested in deliberately^ encouraging the'use of a new informa- 
tion system. Although studies on the introduction of innovations can.be traced ^ 
liack a long way in other fields (Rogers, 196!?; £hin and Benne, 196S; Rogers/* ^ 
and Shoemaker, 1971), it was not until the 1930 T s that Paul R. Morfc at Teachers; 
College, Columbia. University, becana^lb^e first major schot^^to^stud^ the 
adoption and diffusion of innovations in education. During the next 20 yeays, 




lie and his graduate students ,had a virtual monopoly on the fiejd, producing^ 
over 200 studies-. They used the school system as the unit of analysis and * " 
obta ine d their data usually through mailed questionnaires to school principals 
or supexintenden£s .\ They found that the amount' spent per pupil was, the m6st 
accurate^si^gie indicator of a s6hool T s inriovativeness (Mort and Cornell, 1938), 
They found, tod,-* that the diffusion of educational innovations through the school 
was a very slow procedure ; that 3-4:% of schobl systems had accepted a new 

practice at the end of a 15 year period and that it may take as long as 50 years 

\ ' - r 
from the time a new practice, such as kindergartehSs, is introduced until it is 

widely used in the schools. This rate of adoption is* represented by anS- 

shaped curvef (Mort, r 1 953) . The launching of Sputnik with its concommitarit 

emphasis on the importance of scientific, and technical education combined 

" with the American respect for change as a positive- value, worked, to --speed up 
this slow rate of adoption so that by 1965 Carlson was reporting only a five 
year time lag for , the adoption of modern math in the schools (Carlson, 1967). 

_Jt is important for researchers to be aware of tftis slow pace if they are not 
to abandon their efforts at innovation -diffusion prematurely before they have 
had a chance to catch hold. 

The characteristics of adopters have also b&en analyzed. It is pos- 
sible to Categorize adopters on the basis of their degree of innovativeness . . ^ 
Those who are among the first 2. 5% to adopt an innovation have been termed 
"innovators" • 71ey are followed Jby "early adopters" who represent the next 
13*5%, "early majority", are the next 34%, "late majority", also 34%, and 
finally the last 16% or "laggards" (Rogers and Shoemaker, 1971). The per- 
sonalities of innovators have been examined by a number of recent studies. 

The superintendents who adopted modern math" earliest were seen to be .more 

- * •« 

heavily involved in social networks and were higher in the status structure 
than Ikte '-adopting superintendents,. They tended to be yo ung er and more 
mobile and to have higher professional ratings (Carlson, 1967; Rogers, 1965). 
Early adopters read more, travel more, have higher incomes, are better 



educated than late adopters of innovations (Katz, £969). Further, the,"inno- . 
A vator?L tends'to'be venturesome',' rash, daringy and'a risk taker. He is a 
cosmopolite rather than* a localate. Th^ f !early adopter", by Comparison; is- ; * 
a better integrated* member than the innovator of his social system: " he is an * 
opinion-leader looked to fc>r advice by his colleagues (Rogers and Shoe make r, 
1971). The perspnalxiiiaracteristics of school administrator s -at various ^levels 
are important because they have been shown to play a significant rele in the 
implementation of educational innovations (Leas, 1962; Hinman, 1966; Lawrence 
1967; Henderson* 1968). School systems, too, havfe characteristics that - ^ 
contribute toward an innovative disposition. The most innovative schools have * 
been shown to have open climates, higher expenditure per student, and younger,, 
more numerous, and less experienced staff (H alp in, 1966; Mar cam, 19^8; 
National Seminar on Diffusion, JL973) . ■ "V _ . 

^The characteristics of the innovation itself have been found to effect^ 
tjie success of its adoption and diffusion. Further, it is the^fitributes of the 
innovation a^hey are perceived by 'tire potential user and not the researcher 
that are important. The major studies in this area have been summarized to ^ 
show; that the attributes of an innovation that are positively related to its adop- 
tion are the degree to which it is better than the practice it replaces^ its 
compatibility with ex* sting values, experiences, and needs of the potential 
^adopters; the degree to which results can be observed by others; the degree to 
which it can be tried on a limited scale (Rogers and Shoemaker, 1971). Com- 
plexity of an innovation is negatively related to its rate of adoption. Reliabi l i t y 
was seen to be an attribute that superseded cost in importance in some cases 
(Fliegel and Kivlin, 1966). \, V ^ ■* : 

But regardless of the attributes of the innovation, or of the potential 
adopter, or of the adopting system, the indispensable ingredient necessary *to 
-ensure successful adoption and diffusion, of an educational innovation is the 
presence of an intermediary. Whether he or she is referred to as a c hang e 
agent (Roger and Shoemaker, 1971) or a linkage agent (Havelock, 1973b) or 



a knowledge linker (Fsprr, 1969) or a field agent (Sieber et aL, 1972), or an 

- J ■" ; v v ~ ^ - - - * - " • ■ * ~ 

educational ixdformation; consultant (Educational Information Consultant, 1971), 

his role had been tctfjput local practitioners in touch with the latest findings of 

researchers and to facilitate the impleihentation of theory into practice.* As 

has been pointed out, the field^agent in education is, significantly different from 

v'-r ' * ■ . ^ ^ ■ /- ' 

his, agricultural predecessor : he must deal 'with organizations and -with tneinbers 4 



of organizations, not autonomous clients; he must usually deal with clients 
who are not econoroically^^otiyated; and the results of his efforts are not 
as clearly visible or as easily assessed (Sieber et al. , 1972). ^ 



His exact role in education is a varied and complex one. One expert 

f . - ■ , *>■ " 

suggests that he can bring about change in at least four different ways by 

being a catalyst who 1 pressures the client system to change, by offering solu- 

$s tions to felt problems, by^showing the client how to bring about change as a * 

"process helper", and by putting tfte client in touch with resources of various 

kinds to meet his needs (Havelock, 1973). None of these roles is mutually 

exclusive. . Aril involve building a relationship -of trust and confidence with the 



*" client. ^.Tbe'xjdle is the more difficult because it is vague (Sieber et al. , 
1972), and the expectations of clients are mauy ^nd conflicting (Bos, 1^966) „ 
But even so there i^ ample evidence to^show that the efforts of change agents 
significantly affect the rate of adoptioii of ah innovation. The agent is most 
> likely to be successful if he works through opinion leaders in the client system, 

if he»ha$ a high degree of credibility and empathy, and if his programmes are ' 

'. . , . ... v . . 

compatible with his client.s* needs (Rogers and Shoemaker, 1971). / 

■■. • ~ The importance of the agent* s role in the dissemination of educational 
information has achieved a re^pja/ed emphasis in the past five years as the need 
to relay the results of R&D effdrts to the field was recognized. Agents who 
are in the unique position of being able to put those who need to know in touch 
with those who can inforfia them are seen as central to the flow of informatidii 
(Farr, 1969). Recent case studies have helped to shape the position (Lindsay, 
1973; Robinson, 1973; Havelock and Havelock, 1974) and have shown the 



severely decreased usefulness of an information service which lacks suph * 
personnel (Cutter, 1974).^ _ ^ • 

Some of the difficulties these intermediary agents *are likely to face 
have already been alluded to: the ^requisite interpersonal relationships require 
7 the utmost dielieJacy. Human nature being what it v is, people are not naturally a 



given to change their , ways unfess strongly motivated. Schools, in particular, . 
generally have little ^incentive to innovate. The reasons for resistance to change • 
have been attributed to obstacles in the individual such ajs forced of habit, self— 
distrust, insecurity (Watson, ^1.969)/ fear of being unpopular with peers (Pierce, 
1963), and la<£k of knowledge about new practices (Carlson, 1965) • The school 
system is conservative by nature, non-competitive, usually lacking change 
agents, usually offering no rewards for innovativeness. Its silent* prioritie s 
tend to be conformity to norms, respect of \sested interests, and rejection of 
"outsiders" (Pierce, 1963; Carlson, 1965;- Watson, 1969). ' 1 - 

The dissemination of educational information is dependent, of course, 
upon access to a knowledge base of educational research. And it is upqji the 
efficient operation of an information service that the intermediary and his 
clients fnust rely for their information, But /if the role of the intermediary 
is fraught with uncertainty, the role of the Educational Information Gentre is \ 
equally confused. A recent report lists over 125 agencies engaged in computerized 
bibliographic searching' of the ERIC data base (Embry, 1974) . These agencies 
include Research and Development Centres, Regional Educational Laboratories, 
Instructional Materials Centres, Regional Offices o^die U^. Office of Educa- 
tion^ private corporatipns, professional organizations, and university libraries. 
The services offered aild the clients served are presumably even more, diverse 
certainly more^numerdus than the sponsoring agencies. Fox the purposes 
'of this report, we have restricted examples to those state educational agencies 
that provide computerized search, retrieval, and dissemination of ERIC 
materials to educators. Even so, *we find little uniformity in the services ~ 
offered: some centres provide copies.. of fiche free, some provide previously 



prepared information packages, some supply readers. The level of requests • 

# - A v : 

.varies from 150 in Florida to over 1000 a month by the regional -services of - 

«.- ^ * «. . «. 

the Northern Colorado Educational Board of Cooperative Services (Cutter, 1974). 

J ^ome , centres^rely on subscriptions *€or revenue, others charge per individual , 

•request* . Funding" of these centres usually is a combination of federal, state, 

ajjd local participation supplemented to different degrees by revenue from users. 

The existing literature on" inf or hl^gh dis semination reflects ttte newness 

of/the field, Obviouslyv for a special library or a, library within an academic 

■ • -* \. 

institution to make available information retrieved from bibliographic data- - 

bases involves a number of key decisions and issues. Accurate information 

on these decisions and issues would be helpful. \ But when we turn to the - . 

literature, we are reinforced in* the view that this fielekis still in its infancy. 

The costs of providing an automata 3hs ear ch service are necessarily very 

" s _ ■ , * ■ 

closely linked to the, type of organization, the mode of retrieval, the type and 
size of fetaff, and other local conditions. The models that have bejen developed 
may. involve complex mathematical formulae (Cooper, 1972) or less^e^oteric 
means (Elman, 1975), but all require adaptation to local c^ditions. *Mbst of 
the "cost models to vtfate haVe referred to the cost of developing the database 
itself (Lancaster . and Climenson, 1968) and not to the provision of information 
from commercially accessible tapes. / 

It is not surprising that costs have not been clearly calculated when the* 
whole- issue of the library 1 s role in providing such information is itself still 
unresolved. Although it was thought in the early /pays that libraries would bte - 
required to acquire and manage magnetic tapes and that librarians would there— 
fore need to know something of computer applications, it is^ecoming accepted 
now that subscribing to available search services provides an -economic .and 
practical alternative./"! As late as 1973, arguments were being made that the 
library should act as ^n information broker providing access to patrons of 
centrally maintained, commercially available data bas^s* as part of a normal 
reference function (DeGennaro, 1973). The actual implementation of such a 



sfervice is still rare enough to warrant an article in ar recent issue of College 
and Research Libraries (Hock, 1975) . The textbook sponsored by the American 
Library Association for the purpose of training librarians in * computer -based 
reference services, (Mathies & Watson, 1:973) is a' clear indication of the 
course the' profession is- being nirged t<£ take in the future.. In fact, because 

the formulation of searck strategies requires delicate but persistent question- 

; " . ^ - ^ r - . * * . - ' ' ' 

ing of the patron, the new emphasis on question negotiation' so vital td an auto- 

+*- * .• «■ . • 

mated, system promises to sharpen those reference skills that have all too 
often become dormant! - A . - • > - v 

Not only has the integration of "elata bases into #he library — especially 
reference services — ■ been problematic, but also it has brought with it another 
issue that goes to the philosophic core of traditional librarianship : charging^ 
foryservices. Because costs (no matter how calculated) are4ncurred in provid- 
ing im§tee new services, and because ^library budgets are not likely to increase, 
the liefer will have to be changed f^^c v ce'ss to computerized bibliographic infor- 
mation (Penner,^ 1970; DeGennaro, 1973; iJawton and Auster, 1974). This 
foray into the area of commerce has foci^ssed attention en the lack among 
librarians of promotional and marketing skills- that will be necessary to operate" 

successfully self-supporting information services (Kuehl, 1972; Stern et 

- \\ 
al. , 1973). Not only willva familiarity with consumer behaviour research, 

* - ) J(\ 
channels of distribution, and market* segmentation analysis prove valuable, 



but also a more accurate means of predicting fui ;ure demand for services 
should have implications fpr administrators regarding personnel, software^ 
and hardware requirements (Ware, 1973; Lawton and Lawton, 1975). 

• In view of the unsettled state of the art, it comes as no surprise to 
learn that evaluation of information centres is also uncertain. The most^ ^ 
detailed. evaluation studies have tended to concentrate on the data base itself*:' 
rather than on £he delivery and use of the -Information it contains . \ Numerous 
studies have -refined the accuracy of precision re pall ratios (Lancaster & - 
Climenson, 1968; Cleve^don, 1974)^ The evaluation of the ERIC system 
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(Fry;- 1&72) and the earlier MEDLARS study (Lancaster, 1969) provide com- , 
prehensive examples which^the practitioner may pare dow^ to meet some of 

i -^TV* " ■ * - 

his needs. The recent ERIC report entitled "The Evalnatibn ^ Educational • 

•r . ■ - -\, 

Information Centres" summarizes some of the problems inherent in attempting 

to evaluate an EIC \and concludes with the following re c omyn qndation s 1 

l; Efforts must be made to bring about some consistency to the 
terminology associated* with educational inforipaatLon centres, 
* • their roles, and their evaluation needs"; . This task sliould be 

carried out in full cognizance of similar* efforts emeacging from 
\. \ the broader field of information science. The recent establish- ~- 
V ^ ment of Information, Services to E ducation Special Interest 
: Group within the American Association of Information Science 
■* . should assist this group.. " v 

.2. The notion of educational information services versus the 
• " ■ utilization of education information in the educational change ^ 

process must be more fully researched. * . - - - \\ 

r 3. More- systematic efforts must be made to evaluate training 
■ jf resources in the light of specific operational aspects of the 

educational information centre. Most important are the skills ^ 
related to query negotiation, search techniques, 'relevance 
judgements (recall and precision) ; and extension agent for other 
utilization support. ;ii * 

4. While more rigorous evaluation strategies are needed for 

impact evaluation of information centres, replication of 
existing studies are needed to ascertain their applicability to 
a wide variety of centres. - 

- 5. Existing centres must apply more rigorous progra mm e 
- budgeting and cost analysis techniques in order to provide 
a management database from which cost -benefit character- 
istics can be determined (Brickley & Trohoski, 1974, p. 13). ; : V 

. " " From this review of the literature one may draw then several 

y. 

conclusions. It is clear that the development and supply of an educational 
information system for Ontario is' an interdisciplinary effort involving the 
research traditions of £t least two major social science disciplines : educa- 
tion and information science. The literatures of these two fields remain 

j — ■ ' - 

««~ » . . 

distince and separate : one turns to the education literature for insights on. 
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change anH iimovatioSa and to the irifo^mation, science literature f or backgrjouhd - 
* on information cenfcre^^gg ^^ services. This separation 

means that ustil very recently both disciplines were developing independently, V 
each with its own experts, who rarely, if ever, collalxjrated. While the inform 
mation scientists were: involved in solving the problems of creating bibliographic 
data bases that were machine -readable, /the educationists were concerned with 
the adoption and cfiffusionlpf .new ^racticesL Interestingly enough, the ERIC 
data base p;nb videos the best common source to both fields. It is only in the 
^ 1970 T s that there has developed a trend wi thin diffusion research to concentrate 
- on knowledge* dissemination and utilization. - % r" 

The newness of the field ais well as its interdisciplinary nature means 
that there are few researchers or practitioners with experience or expertise 
in both fields. Havelock and Sieber are perhaps the most closely related to 
many of the concerns of this study. Even their usefulness is limited, however. 
They still see the intermediary in terms of a change agent — the role of an, 
information agent or consultant who does not become directly involved in the * 
change process has yet to be spelled out. 

v 

The unique^gualities of the Canadian education system further limit the" * 
direct applicability of some of the U.S. experiences. A shared funding scheme, 
for example, ujg/olving federal, provincial, and local authorities such as was 
used to finance the Pilot State Dissemination Project (Sieber, 1973) is not 
applicable, tc^Ontario. . Needless to say, there are no Canadian studies in the. 

area. : * - v ' 

- The project could not <±faw upon a coherent theoretical framework. 

They have had to tr ain personnel and create the educational information centre, 
define its services, and establish its costs so as to. assess its fiscal viability. 
These developmental aspects merged with a research study investigating users 
and uses of educational information in target areas that ard* geographically 
remote from where the project centre is located . These problems indicated ' 
one thing with certainty: the project would continue to encounter new problems 
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as its work proceeded. But 



ieen i 



in the broad context of educational develop- 



ments, this Ontario project JLs also in the -forefront of necessary and significant 

■ ; ■ b f '[ 

research in education and information. > 
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i CHAPTER III 



EIS6 and OISE : The Social Effects 
of Creating a New Setting 



1 <^ 



The implementation of a major change in an existing organization is 
' fraught with numerous pitfalls. The literature-of education abounds with well 
intentioned innovations that failed (Gross et aU, 1971; Smith & Keith, 1971- 
Wacaster, 1975) . The reasons for failure are numerous and varied: they 
have been attributed among others to the innovator, the innovation itself , and 

- the adopting organization. Oddly enough, however, little of this accumulated 

- wisdom is apparent in the literature of librarianship or information science, 
the subject area of special relevance to the Educational Information System 
for Ontario. Rather, articles in library journals urging the adoption of com- 
puterized access to information, though valuable to the practitioner, limit 
their concern to which data bases to choose and reasons for the choice 
{Williams, 1975) . Rarely are the human problems of implementing such a 
major change broached. It is the purpose of this chapter of our report to 
explore the social, psychological, and organizational implications of imple- 
menting a computer-based, fee— charging reference service into an existing * 
.library setting. In keeping with our view of E ISO as an innovation, the ap- 
propriate reseai>ch will be examined for insights that may be gleaned when 
introducing such a change into an existing setting. ^ 



Miles defines an innovation as a "deliberate, novel, specific cl 
which is thought to he more efficacious in accomplishing the goals of 2 
(X964ri p. 14). Gross, Giacquinta, and Bernstein (1961, p. 16) define a 
national innovation as "any proposed idea, or set of ideas, about how 1 
izational behaviour of the members should be changed in order to" resjc 
problems of the organization to improve its performances". Rogers a 
Shoemaker (1971, p. 19) subscribe to the following:' 

"An innovation^ is an idea, practice, or object perceived 
as new by an individual^ It matters little, s<a far as human 
behaviour is concerned!, whether or not an idea is T objec— ^ 
tively* new as measured by the lapse of time since its first 
use or discovery. It is, the perceived or subjective newness 
of the idea* for the individual. that determines his reaction to' 
it. if the idea seems new to the individual, it is an innovation. 

■ ; / 

The definition put forth by Z alt man et al. (1973, p. 10) that, dra 1 
and modifies this last usage considers an innovation "any idea, practic 
material artifact perceived to be new. by the relevant unit of adoption" . 
adopting unit may be an individual, an organization, or a sub-section v 
^>ri organization. For purposes of this chapter the "innovation will be th 
project, in all its aspects, the adopting unit will be a subsection of the 3 
specifically Reference aricL Information Services. 

There can be little dQubt that the , service is a genuine ixmovatio: 
matter which definition is used as authoritative. ^Everything about the. 
service represented a radical departure f^om the Library's normal mc 
operation. Not only was the idea of such a service new, but als£> the re 
First, of course, was the introduction of computer-based technology fc 
supplying bibliographies that had previously been compiled manually^ 
only could the computer search through vast quantities of material, but 
could do so more quickly, in greater depth, and more efficiently than ^ 
(it also never got bored or developed eye strain) . -.. 

Next came the fact that the service was to be' paid for by the cli 
The librarians had compiled bibliographies on specialized subjects for 



province's educators since the inception of the Institute, but a charge had 
never been levied for this service. Now came the concept of "cost— recovery" 
an attempt to establish a bibliographic .search service on a break -even basis. 
* Third, this was' the first time the Library had participated in contract 

work. There was uncertainty as to what effect this would have on the rest of 

- - - - - , • \ . 

the staff and the organization itself . 

Fourth, because the Library was inexperienced in contract work, 
and this particular government contract happened to be one of the largest in 
the^Ehstitute^ Institute administrators de cided iiiat its personnel. and budget : — 
should be handled by the Department of Educational Administration, which 
was accustomed to handling large projects. For the first time, an academic 
unit would be responsible for staff assigned to the Library, and new forms of 
communication and cooperation would be required. / 

The first of these new forms concerned the direct responsibility for 
thesproject itself, which was to be administered by an academic department, 



but headed jointly by an academic, and a librarian. Never before had such a 
joint venture been undertaken. ^ ~ '< 

Finally, the project necessitated that new equipment be purchased, 
new facilities built, new staff hired, and new. business procedures established. 
Publicity efforts, normally regarded with suspicion by libraries, were an " 
essential part of the project.^ And skills, such as research design and data 
analysis, normally not included in the librarian's repertoire, became of vital 

importance, j - 

In short, such major philosophical, technical, organizational change^ 
were instituted that the E ISO project was certain to precipitate major changes 
in the existing operation of the Library. . 

Rogers and Shoemaker (1971, p* 330-35) classify the consequences 
or changes that occur within a social system as a result of the adoption or - 
rejection of an innovation in three main groups: functional or dysfunctional, 

^dire.ct or indirect, and manifest or latent consequences. The first type 



r indicates whether the effects of the innovation were desirable oT not, the 
second type distinguishes between those changes in the social system that occur 
in response to the innovation and those that result from other or additional * 
cause s,\Nand the last type makes clear which changes are recognized and 
intended by the innovators and which are not. Their main point, However, is 
not to produce an exhaustive listing;: it is, rather, to emphasize that conse- 
quences are not one -dimensional, but can be expressed in numerous ways, and 
that innovators must be aware of the dynamic and complex impact of intro- . * - 
•ducing an~innovation into a social system: ~: ™ ~" - — — > - 

The' immediate result of the introduction of the EISO service on the 
staff of Reference and Information was a reduction in the workload. Compila- 
tion of bibliographies, a major function of the librarians prior to the intro- 
duction of EISO, was reduced by 60% in the first three months, -This re- 
duction in workload created a substantial amount of "found** time, which 
was used to - re —examine the purpose and functions of the R & I service* As : 
a result of this review neV responsibilities were defined and assumed, new 
roles developed, and a functional reorganization of the unit was und^r taken. 
Bach librarian undertook major responsibility for a new function: one acted 
as liaison to field development staff, the second chose to develop orientation 
activities, and the third acquired the responsibility for the unit T s book pur- 
chases. All of these functions had previously been part of the job of the head 
of the reference section: what had started out as a redaction in workload 
became a major change in role relationships. . . ' y 

- One* of the most significant though indirect effects of the introduction 
of the new service was ^vhat Zaltman et al. refer to as the "gateway capacity 1 
of the new innovation (1973, p. 45) r / > 

In addition to the intrinsic value derived from the adoption of an 
innovation, an additional value can accrue to the extent that the 
adoption of an innovation can open avenues to the adoption of 
other innovations. It could well be that the increased opportunity 
for the adoption of other innovations is tha intrinsic value .of the 
initial facilitating innovation. / v 



This certainly turned out to be so in the present case. For example, when it 
became clear that neither teachers nor graduate students balked at paying the 
$30 charge for the computer bibliography, the librarians began wondering \ \ 
whether they could develop other services to raise revenue, and within a few f 
weeks, they had ar r anged^to provide specialized bibliographic research for a 
professor on a fee-laying basis. The example provided by EISO regarding 
contracts undertaken by library staff led shortly afterwards to another cdn- 
^irajctual agreement whereby the Library would provide facilities and services 

~ f or-<^TE C students* The philosophical, -psychological, .-and administrative 

barriers that had prevented the Library from being paid for services rendered 
had effectively been broken. Although the innovators of the project had privately- 
hoped for this result, it had not been openly discussed or encouragedj^y them. . 
^It could, in fact, -|>e regarded as an, indirect as well as latent effect. 

In addition to st insulating an expansion of services and other major t 
re-brientatLons of existing library activities, the new service produced some 
minor but interesting demands for change. Since the EISO service reproduced 
microfiche for sale to users of the search service, and since^it was obvious 
that the duplicating equipment was available on the premises, the Field 
Centres and^Jzher regular users began to request -that the Library expand its 
duplicating services to include microfiche (as yet no action on this request 
Has been initiated). In addition, the EISO service increased the use of photo- 
copying machines by clients as well as EISO staff, in the process increasing 
also the number of journals and microfiche t h at required re shelving.. 

Inevitably the chafes brou^if about by the . service results in several 
forms of resistance. Watson, in a frequently anthologized article (1973) is 
thorough in outlining reasons why individuals and social systems might be 
expected to resist change. He points to aspects' of human personality that 
naturally prefer stability and familiarity (homeostasis and primacy, in his 
terms). 'Habit is a diff icult thing to overcome and established ways of doing 
things (what Sarason, 1971; caUs > "regularities^ tend to take on a sanctity. 
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^1 the individuals affected by the changes are themselves insecure and dis- 

:>trustful, they aire more* likely to feel threatened by innovative methods. *!Fhe 
introduction of a new technology to perform a function previously done with ^ 
pride and skill is likely "to create immediate concerns about the security of 
6ne , s job-. The, fear of being replaced by a machine, though less obvious*. 

" among professional than clerical or assembly-line workers, is, real and 
must be re cognized and dealt witibu * .■ 

The atteAtion and diversion of resources- to the new service may also 
arouse enviousdfeelings, while the hiring^ of new staff with differ ent, 1 'more — t£ — - — 
modern" skills may create fears among regulgx staff members, that their own 
expertise is becoming obsolete. Their purposes and functions come into 

; question and a re -alignment of roles becomes mandatory. All these responses 

were to be seen in th^ reference library as the EISO service was introduced 

and began to operate. * 

If Schein (1974) is right about the socialization of professionals into 

their jobs, we might expect that individuals who have been in their positions 

longest, who have been away from the influence of their graduate training 

* - ' V ■ 

longest, will most likely offer the strongest resistance to innovative changes.* 

.■» 

Other theorists have also pointed out that innovators in education (and there 

is little reason to think that librarians are significantly different) tend to be , 

+ '■ ■ ' 

younger, more involved in social networks; read more, travel more, have a 
higher income and social status, and be more "career-bound" than TT place- 
bound" than their colleagues (Carlson, 1,965; Katz, 1969; House, 1976) . 
As these writers suggest, many of the reasons fbrf resistance to change may 
be private and personal, arising from the distinctive natures- of the people 
involved. Resistance may vary in type and intensity during different stages 
of the innovation 1 s life .cycle and among different staff members-. 

All this is not to. suggest that overt and dramatic resistance is inevit- 
able or that efforts to avoid it will prove useless. On th^contrary, by anticipat- 
ing opposition in a realistic way, the innovator can go a long way toward disai^ningL- 



it. Watson (1973) suggests that resistance wiH be less if those participating 
in the change feel that it is their ovqa; - if "the change rechices rather than in- 

■ % > ■ o< 

creases their^p^e sent burdens; if it is in keeping with their values;" if it 
does not threaten their security; if it offers them opportunity for growths ~ 
He emphasizes the need for group consensus before adopting an innovation, 
for feedback mechanisms, acceptance, trust and confidence among group 
members. Equally important is the need for Wholehearted administrative 
support. 

— ' -In the case under consideration, serious opposition was kept at- a 



TninimiiTn^ though of necessity the process of gaining the government contract 

wks not^a participative one. The facilitating strategies recognized the im- 

portance of full and open communication and feedback mechanisms, the value 

of incentives to promote acceptance more readily, and the necessity of -con- 

gruity both socially and professionally between new and existing staff memb ers 

To keep the information flow steady and^ccurat^ at the upper administrative 

levels, an advisory committee was established with representatives from the 

academic department, - % the library, <and the project. This committee ensured 

that issues pertaining to all three areas could be dealt with in a consistent and 
\ ...... • ■ " '■ ~ 

cooperative mann er. On a day-to-day basis, one staff librarian was asked to 

work with the project staff in the library to resolve problems of practical 

detail. In addition, demonstrations and seminars explaining the new service 

were held, and project reports of a non-confidential nature were circulated y 

for information^ to all' libraiy staff members.^ The most effective means ofv 

keeping in touch, however, tended to be. social: an ice cream party early in , 

the process provided an opportunity for" the two staffs to mingle with one 

another. It was followed by informal gatherings to ^el^brate Christmas and, 

other festive" events during the year. The addition of a coffee pot to an empty 

office did much to integrate the project and library staff s and to elimi n ate 

social as weH as organizational barriers. 



'.njic 



; • / 24 

Realizing that there are usually few tangible incentives for staff 
.embers to engage in innovations (House, 1976), the project team devised 
^a number of "regards" that proved to be attractive and persuasive. The 
( library staff was given the equivalent of $100 free time per month to access 
i* the computerized data bases for purposes* related to their own work interest s± 
"There was also the prospect that the computer terminal, microfiche duplicat- 
ing equipment, and i microfiche reader as well as a fully equipped office 
built and furnished from .Field Development funds would become library property 

gt the^completion. of the- contractedLre search* _ JLastly, _ f undsito eiiable, the h i ring ; 

of Wo temporary staff members were allowed^to revert to the Library* v 
To minimize the gap between new and existing staff, the decision was 
taken to hire a fully qualified librarian rather t h an a research officer or 
-computer expert to" run the service aspect of EISO. This congruence between 
the qualifications of the new and existing professionals went a long way toward 
increasing her acceptance by regular staff. • « ■ 

Finally, the new service was made as nearly self-contained as possible 
in terins.of workload. This was done not merely to control and study research / 
variables accurately, but also to minimize the workload regular, staff members 
would have to bear as a direct result of the project's existence. For ex amp le, 
the EISO assistant did all the photocopying generated by project clients, not 
relying on the library 1 s photocopying services. ^ 

■ * j. 

Obviously, facilitating strategies will be more effective if positive 
efforts are exerted not only by the innovation's proponents but also by the 
staff df^he adopting unit. Again^ the jprbject wa^'pa^cxilarly ^f6rfain^^to\r ^ 
have the unswerving support of the unites adnrrini strator V Through her inter- 
vention, reciprocal integrative 'efforts were" undeirtaKen. The : project staff — 
were urged to participate *in library staffomeetings aJSA^o give progress re-7 
ports. They were invited to spc^ 

tion and by individual staff members;. The project office was included -in the 
orientation sessions and tours giv^n by the "librarians. And a generally positive* 
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feeling toward the service, "the research, and the staff was encouraged bj^the - 
unit Administrator 1 s affirmation of the professional ideals of her staff. 
Ironically, as a side effect of the determination to minimize any disruptive 
influence of the new service, it became common among the librarians to deny 
that ifrthad Wiy significant effects at all, making it a bit more difficult to deal 
with vplid objections and to take steps to relieve unnecessary fears. 

It should now be clear that the introduction of a computer-based 
reference service. into an existing organizational setting is a complex under- 
taking. > Some of -the problems maybe foreseen,- others^ cannot. — It is hoped — — 
that by drawing upon the existing literature of education and information 
science as well as -actual experience, a contribution- has been made toward 

documenting some of the social, psychological and organizational consequences 

• ■; ■ • * . .. ■ •: ■ ;■ ■ ■ - — . 

that might be expected, by those who embark upon a similar undertaking. 
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CHAPTER I V 



Training Educational Information Consultants 



When, early in 1975, Hie Ontario Ministry of Education contracted 
with The Ontario Institute for Studies in Education to investigate the demand, 
the technical requirements, the use, and the fiscal viability of offering an r 
interactive on-line bibUogi^aphic search service to the educators of this < 
province by providing access to the existing education data bases, one of 
the specifications of the contract was to "study the effectiveness of an inter- 
me diary (consultant) in interacting with users in a remote geographic setting 
in northern Ontario in clarification of search scope and in interpretation of 
output" and to "develop and refine strategies of utilizing such services through 
existing remote service facilities, such as a field office of OISE, a regional -■ 
office of the Ministry of Education, and an office of a school board". 

The concept of change agents is of course not a. new one but derives 
from, the use of agricultural extension agents in the U.S. at the beginning of 
this century. ^Nor is the use of change agents in education a recent develop- 
ment. However, the use of intermediaries with specific functions with regard 
to infoirmationjpurveyance, is a direct result of the increasing rate of infor- 
mation production combined with the recent invention of computer technology 
to handle it. . : * ' . f " 

I It has by now become commonplace to refer to the "information 
explosion" in all fields of knox^^^ge. We are told that knowledge is doubling * 



every ten years and is likely to continue to grow at an increasingly faster 
rate* Information ^pecialists have been aWare of the problem for some time 
and in the last two ^^fflpos have attempted to find new ways of controlling and 




m^lH ng available ^jS^^^^^^tieg of materials to specialists in various subject 
areas. Although ^^^^^^St^^t^(^^h^i.CBX advances in information retrieval 
were /first applied to" the areas of medicine, chemistry, physics, and engineer- 
ing, they are now also available fo& use in education and psychology. Ironically, 
however, the increase" in the amount Qf information available and the creation , 

of new methods for handling-it have not -made the- life-of the-average educator 

easier but have, on the contrary, served to increase the "knowledge gap". 
While it may no longer take decades.for a new educational practice to be widely . 
adopted in the schools as it. did. when Mort made his famous studies, we have 
little ^evidence to show that the findings of educational research are having a 
significant impact in the classroom. 

Those who have devoted serious study to the problem, Sieber (1972) at 
Columbia, Havelock XL9$3) at Michigan, and Hood at the Far West Laboratory, 
have all- pointed to the lack of training the average educator, be he teacher or 
administrator, has in being able to identify sources of information in a systematic 
\yay: he does not -know what bibliographic tools are available, which are most 
likely to be useful to him, where they are located, ho^. to get them, or how ** 
to use them. Further, he is unable to translate .what he does find and apply 
it to his own classroom or school. Often, he is even unable to articulate his - 
problem in such a way as toi>e able to find help in solving it. To help bridge ' 
the gap between the research and the classroom, the scholars have suggested: 

> - ^-:> '.v : ■ * > - j ; - ■ \.-.:-\- . r v -v; ■ " . ; .\ ■ ■ 

the use of linkage agents' pf various kinds. These, people would ideally be 
people knowledgeable about available resources, familiar with the needs of 
local educators, and skilled in facilitating the introduction of new practices 
into the schoot setting* Although,; as both Havelock and Sieber realized, 
persons with such skills are still rare; the Province of Ontario is particularly 
fortunate in that various mechanisms and organizations are already in existence 
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whose function it is to help local educators in various ways. Examples of 
such agencies are the Regional Offices of the Ministry of Education and the 
Field Centres of OISE. It followed naturally then that in selecting persons to 
act as-JEICs, the project team would turn for trainees to these established 
local sources. 

As \ result of discussions with Ministry officials, the North Bay area 
(Region 3) consisting of 17 Boards of Education was chosen as target region 
from which detailed research data would be collected on the effectiveness of 

- using Educational Information Consultants to negotLate-inf ormation requests 

with users. This region also received preferential treatment with regard to 1 
equipment, price structure for searches, and professional development 
activities. 

In order to compare the use of fiche between -schools with and without 
microfiche readers, portable readers were installed in several local elementary 
public and separate schools. Along with these were installed "Educational 
Information Stations" containing sample bibliographies, fiche, journal articles, 
search request and order forms, and instructions for using' the EISO service. 

To test the level of demand for searches* in relation to price charged 
per search and to test the effect of offering free searches as a stimulus for 
further usage, a special price structure was implemented for the 17 Boards 
in Region 3, the local Community College and the Faculty of Education, and the 
Regional Office of the Ministry of Education/ For the boards and colleges, 
free searches were allotted based on the number of stuctents enroled* The 
Regional Office allocation was based on the number of education officers 
employed- For example, with one free search per thousand stpdents, and with 
a .minimum of five free searches per board, the Nipissing Board with a total 
student population of over 13, 000 students is entitled to 13 free searches. 
When the allotments of free searches are exhausted, the fee per search will _ • 
be $20, well below the $30 fee charged the rest of the province. \ - .. 
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it the most important variable differentiating Region 3 from the rest 
of the province is the provision of Educational Information Consultants. 

Separate meetings with government officials/ educators, and OISE 
personnel were held in North Bay during which the concept of an EIC was 
introduced and elaborated. The information consultant was pictured as an 
individual employed by a local agency who would be trained by the project 
staff to assist local educators in f o ru ml a ting their information problems, 
and supplying them with whatever further assistance was required. 

L_The Role-odLEducational Information Cons ultant was outlined as follows 

, 1. Gain access to potential users; 

a. Let clients know you are there and why 

b. Describe service you can offer 

2. - In cooperation with clients, identify information needs; ,J 

3. Help formulate problems; ■ 

4. Relay request to OISE; 

5. Deliver and interpret bibliographies; 

6. Assist in ordering complete documents^ 

^7. Follow-up and evaluation. m ^ 

+. 

Each information consultant was to be responsible for a specific con- 
stituency. As a result^ of these preliminary meetings, it was decided that 
there would be three "official" EICs who would be trained by the EISO team.- 
Two of these would have back-up people- supporting them. The EICs from" 
North B^ty were the Chief Librarian of Canadore College who would be re- 
sponsible for clients in-his College and in Nipissing Faculty of Education 
that shared the same buildings;- an Education Officer at the Regional Office 
of the Ministry of Education who would help his colleagues from the local 
office; the OISE faculty ^member attached to the Northeastern Field Centre 
who would have? primary responsibility for the five southern boards of educa- . 
tion in the region and secondary responsibility for the 12 northern boards* 
Both the government and Institute EICs had colleague s<avatilable to assist , 
clients in their absence. . 
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On the understanding that the EISO search service would begin full 
operation in the fall, four of the possible five EICs were trained during the 
late summer and early in September 1975* Training took place at OISE, 
lasted a full day, and was paid for by the project. 

The general objectives of the training sessions were to familiarize 

the EICs with the EISO project and service and their part in them. Specif - 

{ * 

ically, they were to .meet the project staff; become familiar with the contents 

* ' • *■ 

and use of ERIC products such as Resources in Education, "Current Index to 
Joumals in Education, " " Thesaurus of^ERICrDescrjLptors, ~ahd~the mfcrbfrche 
collection; gain an understanding of search processes, both manually and 
automated; learn to negotiate search requests, interpret bibliographies, and 
order original documents in various formats. (See Appendix K for Training 
Schedule.) * * . * 

Adjustments were made to the depth with which each of these' areas 
was treated in accordance with the^^perience and background of the indi- 
vidual EIC. However, all underwent demonstrations and simulations of the 
EIC f s role vis-a-vis the client and r-eceived information packages. " ^ 

Although the technical aspects such as procedures for submitting 
requests to the analyst, ordering documents, anct methods of payment were * 
outlined in considerable detail and forms were supplied to each EIC for these 
purposes, other areas were treated with much less specificity. For example, 
the project staff purposely did not insist that the EICs follow through on the 
information delivery by becoming actively involved in the subsequent program 
changes that might result from the newly acquired information. It was felt 
that the variation in, skills of the EICs as. well as their different position 
militated against such a prescription. Further, it was also felt that the 
diversity of clients that formed the constituency of each EIC would negate any 
single overall follow-through scheme. 

The purpose of this chapter is a st^ctly circumscribed and limited 
one: to gain an appreciation of the effectiveness of the training program of 
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the EISO project In training EICs. The results will be used to alter any 
tralplng given to subsequently-chosen EICs." 

The goals of the training progranj. and a brief description of the train- 
ing session were outlined above. A questionnaire was designed to evaluate 
the degree to which these goals had been met. This was mailed to each of the 
three EICs in North Bay with an explanatory letter (see Appendix K). A week 
after receiving this questionnaire, each of the EICs was interviewed in North 
Bay* These interviews supplemented the written responses, and gave^a richer, 
mor e indivi dn ali zed picture of the~ way- each EIC carried out his role and how 



adequately he felt his training had prepared him. They also" served to highlight 
unforseen pirqblems. . 

* • * * 

The Questionnaire , . ' 

TSach EIC attended a training session in the late summer or early 
fall. It was felt that an assessment of the training, should be undertaken in 
the late fall, after the EICs had had some experience in their new role, but 
before all other training sessions had been completed so that modifications 
could be made in the programme. Consequently, the questionnaire was sent to 
the EICs in mid-November 'and follo^efd up by an interview a: week later.. 4 
The investigators were interested in gaining information in two broad areas 
that might Jbe labelled factual and intuitive (or cognitive and behavioural) . 
The first concern was that the EIC go/away from his training session with a 
clear understanding of the technical aspects of the* project, i.e. , how to . 
place a search, how to interpret a jbibliography, how to-order documents, etc. 

S"' * 

These concerns were addressed Jby Questions 2 and 5. /The second concern ■ 
was to determine whether the individual trained had internalized his role -as 
EIC, how he had done this, and to- what extent. Questions 3, .7, 8, 9 and 10 
address these issues in part. Expansion of these topics was followed up in the 
subsequent personal interviews. The remaining questions, JL, 4, 6, and 11, 
treated the overall conduct of the session, i.e. , the length of time spent, the 
effectiveness of presentation. " "* 



.32 

In general, the EICs rated the overall effectiveness of the training 
sessions between good and excellent. Two of the three EICs commented on 
the lack of time available to cover all the topics, even though the session 
lasted well into the afternoon. As a result of this perceived lack of time, 
better ways of organizing the training schedule will be explored so that EICs 
do not experience frustration in trying to master too much material in too 
short a time. Our initial plan had been to^have a two day training session, 
but this was discarded because of practical problem?, time away from North 
Bay for educators involved, increased expenses iofcurred, - Also, we as invest!' 
gators were uncertain whether prospective EI Cs might be discouraged by a 
lengthy treatment of such "dry" subject matter. We had clearly underestimated 
the commitment that the EICs were willing to make! As experienced by the 
first EICs> the training was judged to be "too short" by all three trainees. . 
However, all agreed that the level of treatment of the sessions was "just rights ; 
two felt that the amount of detail conveyed was "just right" and one that more 
detail would have been useful. In commenting on this aspect of his training, 
one EIC felt that he would. have benefited from working out more searches, 
both alone and in conj unction with the analyst. Another EI C felt hazy about 
how to relate Thesaurus terms to each" other. Again, the investigators had 
underestimated the interest the,EICfs would have in actually c6nstructing- 
search strategies as distinct from helping clients to formulate their, information 
problems in narrative fornix With regard^ to helping the prospective EIC learn 
his new role, the tr aining session ranked, second in two out of three instances, 
after the trainee 1 s previous experience working in the field. Next in ijmportance 
in helping him to shape his role as EIC came trial and error in dealing with his 
clients. The problems that the'EICs encountered were not directly related to 

• * ' s ■ i-* r . * 

the tr aining session. These included the lack of customers, and the desire of^-^ 
local educators for curriculum materials of Ontario origin . 

Of all the specific informational aspects the training session attempted 
to convey, only the purposes and services of the EISO project were perceived 



■ ■ > '.. - ■ 33 ' 

as having been explained clearly. The otiier^informatibn components, use of 

ERIC indexes, for mulation of -search strategies, interpretation of bibliographies 

and ordering procedures for documents were all seen as having been explained 

fairly well, but below the optimum level possible. Lack of clarity and specificity 

were identified ^s limitations of the training sessions. Perhaps allowing more 

time as well a&ad diiig more detailed explanations would improve understanding. 

Although ; there is a fair degree of agreement among the tjiree EICs r 

about the effectiveness of the training session with regard to the factual infbrma-r 

tion conveyed, the types of behaviour changes that resulted in each case were 
•* ■ ■ . ■ • 

different. While each prospective EIC was given the same list of objectives 

that he was expected to fulfill in his role as EIC, each was left to operational* z e 

these'objectives in a manner most suitable to his particular situation. Each 

brought his own experience, training, and personality to bear and created his 

own distinct, orientation. . . / 

In answer^td^^e^question, "What do you see as your role as an EIC jas t 
a result of your EISO training?", the Ministry EIC responded- "Assisting the 
clients to select the exact descriptors which would provide the information which 
they wish"; the Field, Centre EIC answered: "The value of an'EIC would lie 
mainly in th& conceptualization of a problem area prior [his e mpha sis] to a 
search"; the Community College/Faculty of Education EIC replied: "To 
give maximum assistance to the user I must be accepted as a 1 co nfi dan t e y and 
temporarily at least a participant in whatever project the user is undertaking. 
As in all reference work, ^ the problem is to get the full story on what the client 
really wants and is trying to do. From that point my responsibility is to 
translate the problem or question to the access language of the system". 

What becomes apparent here is the influence or effect the EIC 1 s nor mal * 
role has on his functipning as an EIC. The Ministry EIC, used to a traditional 
organizational environment, has chosen to emphasize me f brmaiized, ■» structured,, 
classif actory aspects of information definition. He does not see himself 
iT^ifiof-iTigr s ea rch requests, or following through by facilitating change. His ; 
approach is simply to select descriptors or subject headings for his clients. 



The academic orientation of the Field Centre EIC is obvious immediately* 
He is not interested in the mechanics of strategy formulation, but iirSie * 
accurate conceptualization of the problem* His gmphasis is^on the significance 
of the problem itself and creating or selecting appropriate theoretical frame - * 
works. Interestingly enough, this EIG undertook a variety of activities, few 
of which were suggested by the training session, and most of which were 
discovered by interviewing his secretary and a student "of his. 

\' The em p h as is of the third EIC reflects the concerns of public service 
\J£braxians everywhere : the^ importance of ;gocfd interpersonal relations with 
clients. So much of his effectiveness is a product of his abcei>tance as a 
colle ag ue by his co -workers within the organization, that a prime focus of any 
role- he fills wilTbe to establish and strengthen such contacts. He recognizes 
that his new role derives from the reference techniques he is familiar with . 
and he is able to adapt and modify this expertise to wh@t may be regarded as 
a new variation on an old theme : computer -based reference services. Instead 
of using a card catalogue," he now uses a Thesaurus aicL in place of Library of 
Congress subject headings^Jje uses ERIC descriptors. Only the Boolean logic 
is entirely new, 

. As a check' to the question above, another query a skin g-EICs to describe 
their activities as an EIC was posed. As might be -expected, these -activities 
related closely to how the individuals saw their roles. The MMstpy 1 s education 
officer assisted clients to select descriptors. The Field Centre TOpresentative. 
consulted with^schoolbdard personnel about sfearches, advised and/oy dir<ectecL ^ 
searches of good students, jand advertised the existences of the iJBp service;, 
The Community College librarian promoted the project, interacted with clients, , >. 
ordered material for clients, and?explainecl the. system and mate rials to clients „ 
In further attempting to determine whether the EIC s had internalized — 
their new role, we asked where the EICs turned for their educational informa- 
tion needs, whether they used the EISO service in the coirt^se of their normal 
duties, and whether their EISO training had influenced Jhie way they approached 



their normal duties. Only the Ministry EIC did not list ERIC as an educational 
information resource. While tiie other two EICs sometimes used 'the EISO 
service in- their primary roles, the Ministry EIC never did. None of the three 
thought that the EISO tr aining had influenced the way he approached hisjnraraial 
re^onsibilities. As we will see. from data collected from th^st&se^uent 
interview, this la:st, view was not (entirely corroborated, especially with regard 
to the Field Centre EIC. — v r 

X»astly, we come to recommendations EIC s might have for changing 
and/or improving their training. All stressed that more time w^ required. 
The Ministry EIC wished that more . attention were given to selecting accurate 
descriptors while the Community Collie librarian waiited'inore detailed in- 
formationron the technical aspects of interacting on-line with the data base. 

r . . ; % The Interviews 

About a week ^and a half after the que stionnaire was distributed to the 
.EICs, the principal inve^pKgators paid a visit to North Bay. Among the 
purposes of the visit was~the desire to see how the EICs were responding to 
their roles after their iT"f"»al f^r^mrt^ th«*y wei-e* operationalizing their, 

roless in their own settings, what foUbw-^-up, clarific^ipn or procedural help 
th^y mig ht need, l^ach EIC was interviewed at his office for close to two. 
hours What/emerged most strongly f rom these conversations were the 
different ways the three EICs had taken the concept of Educational Information 
Consultant and adapted it to fit their specific needs and positions^ . > 

f The first EIC interviewed was the. one located within the- Regional 

Office of the Ministry of Education in North Bay. His EISO responsibilities 
were limi ted to his 28 colleague's within tlje Regional Office. He was asked ; 
how things were going, what he did as an EIC, whether "he had encountered 
any diff iculties, and what suggestions or other comments he would like to 



He described his function as mainly a passive, responsive one.,, That 
is, he felt that following a general- announcement made by his Regional "Director J 
to all staff about the availability of the new service, his role was to help 
clients who sought him out of their own volition. When /clients came to him, - 
he usually requested that they write put in 100 words or less' what their problem 
was. He would then choose appropriate* descriptors, fill out tlie EISO Search 
Request Form, give it to his secretary for taping and forward it to title pro- 
jects search analyst at OISE. Of the five free searches that had been allotted 
his office, ail had been used by January 1976, six months after they had befen 
allotted. Users included one special education specialist who fished to keep ■ L; 
his information up to date, one individual working on his doqtprate, and one. 
education officer sitting on a committee charged with the task of developing a 
curriculum guideline. The EIC\had.hot solicited any of th^se requests, but had 
relied on individual motivation. When he was asked howfe viewjed his role as 
EIG,. whether it was burdensome to him, his reply was : \ f JEt f s paxt . of my job. 
Something that has to be done. TT : "C\ ^ •'•'['■. - /■ ■ : '• • i ■■• " * 

He did venture the opinion that once the rem aifring free searches were 
used up, th^ $20 fee 9 would poise a considerable barrier to using the service^ 
He described the stringent economies prevalent in the C^ice- and doubfed . 
whether the Office administration, would Authorize f unds to be used for searches. \ 
The main vaiue^of the service, he felt j was for high priority com m ittees . He 
did not think it was valuable for individiisd: use. j His suggestions fbi^jimproving . 
the training of EICs centred around, providing them with more ex^rifence doing 
searches and using descriptors: He felt that formulating two searches with the 
analyst and then two alone that would then be evaluated by the analyst would put 
the EIC in a better position once he returned to the field. 

Qn the whole, ^then, the interview confirmed the general information 
obtained from the questionnaire. The specific information that had been the 
focus of the training session had been learned :" the EIC;know the technical . 
aspects of formulating a search and could relay -received: request s^.to the 



* analyst* No 'significant cha ng es in behaviour, however, were immediately 
discernible : the EIC did not solicit clients, <he had held no information _ 
sessions for his colleagues, nor had he set up any of the display materials 
provided. When lie himself needed educational information, his first inclina- 
tion was to turn to the Ministry's Resource Cferore in Su^ury, not tothe ^ 
service for which he was a local rep re sentative.r -One might conclude then 
that .there had been only a limited internalization of his new role, 

\ The interview with the OlSJE Field Centre EIC revealed a significantly 
different approach. As a result of tiie joint me eting referred .to ear lier 
between Ministry, Field Centre, -and project staff , the Northeastern Field 
Ceittre had been designated responsible for searches generated in the five < 
southern boards of education in Region 3. From our conversation with the - 
Centre EIC, we learned that several activities had been initiated in the local 
boards : the Curriculum Project Gb^itiinator of the East Parry Sound Board 
had been recruited and trained as an EIC for his school system and two requests 
for searches had been submitted by his Board. An Educational Inform 
Station had been seft up at the central office of this Board as well as in the 
central offices of the Mixskoka;^ The Nipissing Board had been encouraged 

to participate and had borrowed a microfiche reader frjt>in Centre. " Within 
the Field Centre itself, different types of displays had been set up to advertise 
the service: on' the wall at the entrance to the offices, an ^eye-catching assembly 
of posters and pictures had been erected and inside, an Information Station 
had been set up. •/ ' • 

• The Ce&tre, EIC "viewed hi6 major re^orisibility as "helping people v 
sort out ideas". Once they had been helped to do thajt, he then added new 



conceptual information for them, to react to and- incorporate into their pwn 
mental framework. He differentiated his EIC activities according to his major 
functions within the Field Centre. In Ms role as- Instructor of a graduate course 
in curriculum , he felt that his responsibilities vis -a--v?.s the EISO project 
were to help students clarify their problems, to assist them in identifying the 



type of material they wanted, and- to have them compare their searches* His 
-course had been structured so that only those having specific responsibilitiea 
for implementing curricula were encouraged to attend. The. general topic — 
of the course was problem solving within curriculum and each student had been 
assigned a search in a specific area such as reading, geography^ or math, 
so that collectively, all the searches would represent an integrated approach 
to problem solving in curriculum. _ ^ - .< * 

In his capacity as Curriculum Facilitator, this EIC had been working 
with local" boards helping- them to arrive at goal priorities for their system. 
In this capacity, he would help boards conceptualize what they wanted and" 
assist them ip*identifying the components of a programme. He woulS then _ 
urge them to^submit a search for each components His clients had not yet 
reached this last stage. 

His third major function as Information Disseminator fitted equally 
well with his role as EIC. In this, capacity, he was free to advertise the 
service as he wished, encourage the training of local EICs^Nase the service 
for hisN^wn projects. 

It became clearPto us from the interview that though the basic train— 
ing provided by the mroject had been effective, these individual adaptations 
could not have been prescribed by project staff even if fliey had been foreseen. 
Neither could we haveNhoped, within the limited amount of time allotted to 
training of EICs,^ to inculcate the variety of skills that had already /marie this 
individual a successful change agent. " His previously established relations 
with local educators, : the trust and esteem in whifch he was held, as well as ; 
his academic training and position all combined to ensure that he wpiild become 
an" imaginative, resourceful, and effective EIC. Our experience with hirh 
suggests not so much how v^ shoufd alter the training of EilCs as those combina 
Hons of skills and training to seek when recruiting future EIC 3 to serve similar 
functions. ,/ . , ^ , . : . : . : l *; .. :\ 



This is not to say, however, that only Field Centre personnel make 
effective EICs. The Community College/Facility of Education iEIC integrated 
his duties equally well though quite differently. Whereas the Field Centre 
EIC viewed ^information as a powerful tool that must be used responsibly, 
and took what may be termed as an ethical stance on information utilization 
giving guidance on when and for what purposes it was to be sought and -how it 
was to be used, the Librarian saw himself as an impartial or .neutral inform a- 
tioji purveyor. His behaviour conformed most closely to the actual training 
given EICs* He helped clients clarify their problem, chose appropriate 
descriptors, checked his choices in his library T s indexes, submitted the 
request tp the search analyst, and interpreted the bibliographies to his clients. 

The Community College and Faculty of Education share one physical 
facility, though each institution is administered separately. The Library 
and its librarian, our EIC, serve the students and faculty of both organ! za- 
tions. During ^he years he had been .employed at the Community College 
before the move to shared facilities, he had built up a loyal clientele who 
naturally sought him out to help solve their information. problems.^ When he 
became an EIC, he called a meeting of department chairmen within his college, 
explained the ERIC system, the new. search service, and the availability df ^ 
free searches. He was able to use as an example a sample search done for, 
a faculty member and so stimulate immediate interest. He also demonstrated 
how each instructor could receive the results of. a colleague's $70, 000 research 
program for 35£. Since his library had paper; copies of the ERIC indexes, 
microfiche readers, as well as a -reader/printer, he was able to demonstrate 
how the new service could augment the facilities already available. 

The different orientation, aspiration, and interests of the staff at the . 
adjacent Faculty of Education necessitated that another approach be taken 
there by this EIC, In this organiz a tior£, he chose to. work through the- Dean 
xather than make direct approaches to clients. The Dean met with his staff 
and the faculty decidfed to give the free searches to -the students." The project; 



brochures were posted on the bulletin boards but as yet no requests had been 
generated* "P" . ~ \ - :. % 

It becomes apparent that the EIC f s regular position affects to a very 
significant degree how the EIC will approach his task and how effectively he : 
will carry it out. Of equal importance are his training, experience, inter- 
personal skills, as well as the relationships he/has previously established 
with his colleagues. . Nor are personal characteristics like intelligence, tact, 
^persistence , enthusiasm, and imagination to be undervalued. For to carve y 
out a new role successfully, the EIC is undoubtedly required to, use each of 
these in good measure. - 
, It is clear that once a person decides to become an EIC for the project 
he wants to learn as much as possible about the project and Mis role in it. 
It has been a mistake to underestimate the commitment of flie EIC and to try 
to condense the training sessions into as short a space of time as possible. 
It >i?« been equally wrong to try toyoversimplify the complexities of automated 
information retrieval and the role of thef EIC.. It would, seem that as a^result 
of the expressed needs of the EICs, the following changes should be made in 
future training sessions. 

1. Future EICs should be offered the option of a longer, more 
detailed, two day training session. . 

2. If the two day package is inconvenient for the EIC, his one 
day training should occupy a fuUV working day. 

' 3. Additional opportunit ie s should be made available for the EICs 
to* work out search strategies on their own and to have these 
^analyzed by the search analyst. 

4. Greater emphasis should be placed on the technical aspects 
of information retrieval • — -the relevant aspects of thesaurus 
construction, Boolean logic, etc. 

5. Care must be taken to explain with greater clarity and in more 
^detail use of ERIC indexes, formulation of search strategies, 

- interpretation of bibliographies and ordering procedures for 
documents. - 



t>.» The emergent roles of the incirmbent EICs could be used as 
examples to guide trainees in options available to them. 

7. In selecting future .EICs, careful consideration should be given 
/the individual's current position, his training anjT experience. 

/ . .. • . ■ ■ ■ • • ■ - ' ■ *••***• 

As a result of t he data collected from the questionnaire, interview and 

personal observation, certain other courses of action not specifically related 

to the training session suggest: themselves. For example, facilitating an 

exchange of experiences between EICs Tfnght provide not only: suggestions as 

to how to cope with specific problems, but also create a greater sense of 

participation and integration with .the project as a whole. A workshop might 

be held to which all EIGs would be invited. They would not only' interact with 

each other but learn about the latest developments of the service, be kept ^ 

abreast of the research aspects of the project, and have a chance to compare 

their operation with others in'the region. * * 

It is also incumbent upon the project staff to supply more feed-back 
to the geographically remote EICs. A monthly newsletter might serve this ~ 
purpose. " 

The EICs also need more "public relations" types of materials, samples 
of service products, training manuals .that they can use with their clients. 
The Education Information Stations shobld help in this regard* 



All in all then, this investigation into the effectiveness of the training 
programme for EICs has been a worthwhile undertaking yielding a considerable 
amount of valuable information which will be used to improve numerous aspects 
of the Educational Information System for Ontario* - 
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CHAPTER V 



Business System's Design and Operation 



■0 



In addition to creating a new unit housed in the OISE Library and 
training Educational Information Consultants, the Educational Information 
System for Ontario was faced with* developing" an adequate- business system. 
Adequate records were needed to ensure that obligations related\to the proces- 
sing of requests- foir searches and for materials (microfiche and paper copies) 
were met, that financial transactions were documented, and that satisfactory * 



reports could be prepared. 



jularly difficult was development of a work- 

\ 



able cost-recovery programme f or users within The Ontario Institute for 
Studies in Education, v 

Creation of each of the records systems mentioned above was approached 
in the same way. First, EISO staff members discussed the topic among them- 
selves and with key people at OISE, most often the Academic Service? Officer 
in the Director's Office and personnel from the Institute's finance unit. Next, 
steps composing the process under consideration were outlined,; the points at 
which documents were needed identified, data required on these forms noted, . 
and individuals to receive copies of forms chosen. Draft forms were then- 
prepared, reviewed by the staff and key people £fx the Institute, and multiple 
Xeroxed copies prepared for trial use . After several months of 'trial use, 
forms were .altered in light of suggestions that had arisen during the trial 
period, paste — ups were prepared by the OISE Editorial Division, and final 



ERIC 



versions were printed, using. NCR (no carbon required) paper in different 
colours wherever multiple copies were necessary (Appendix N). In several 
cases final layouts for forms have not yet been designed; in others, future 
changes have been planned even though "final" printing has occurred. 



0 



• Processing Search Requests 

Six stages occur in processing search requests : submission of the 
request by a client, negotiation of the topic between the client and search 
analyst, ;entry of search into /the terminal by the analyst^ off -line printing of 
the bibliographic references m sd 11 ng of bibliography, and mailing to the 
client of a confirmation that the search has taken place. Two of these, the 
first ,aiKi last, require specific documents. Appendix items N (i), (ii) and 
(iii) are three versions of the-EISQ search request form. The first is completed 
by^the search analyst for users making their requests in person or by phone. >: 
. The search number, at the top right of the form, is of particular 'importance 
since all files are kept in ord^r of search number; ais well, all research data 
are grouped using the search as the basic unit of analysis. One copy of 
form is retained by EISO, and one is received by the client. 

The second version of the EISO search request form is designed for - 
completion by Educational Information Consultants. ^oEISO, the EIC and the 
client receive copies. Tlie third version of this form is that used on the EISO . ^ 
brochure and in publicity articles. It is meant for the direct use of the client. 
Use of the fbrm'is optional; the one copy is retained by EISO though the re- 
questors may well make duplicates for their own records. 

All searches received and executed are logged by the library assistant 
on form N(iv), and form N(v) is sent to* the client so that he is aware the search 
is on the way. If possible, the date they actually received the bibliography is . 
learned by the -EISO staff and. added to the search log. Bibliographies; from the 
Lockheed system, however, .are all sent to the EISO office since that system" 



does sot have the capability of accepting different addresses. T^Tse are then 
relayed to the cliepTby EISO, omittLng the form letter N(v) . . 

Accompanjnx^ eith^ the form letter or, m the case of Lockheed^ the 
bibliography itself, is a brief primer, f 'Under standing the Printout", ^ (Form 

N(vi>). > • ... ,r 

Processing Requests for Materials 

In addition to sending the user an explanation of the terminology used v 

in the bibliography, EISO . forwards order forms for imcro&che^iSd^^per " 

- ■ "■ ' ' • . '• s ■■" * • ■'■ ■ v -. - : : .' - 

, copies of materials .^orms £N(vii), . and N(viii) ) . The first of these is for" 
* ■ * *. * - ■ '*.".*" 

ordering microfiche copies, of ERIC documents or paper copies of journal 

articles from EISCX The OISE Library; in which the EISO office is located, 
maintains virtually a. complete collection of all ERIC microfiche, and journal 6 
indexed in the Current Index to Journals in Education^ Users are not required 
to use this form, r and many orders have been received on various organiza- 
tions* standard order forms,' These orders have been satisfactorily processed-N 
without delay* Regardless of the form used, all orders are logged on form 
N(viii). \ ; ^ 

Microfiche copies and. paper copies are prepared by the library assistant 
■ (Appendix M>,^ and sent to the requestor. If some materials, are not available, ^ 
fprm letter N(ix) is sent, listing the missing materials, providing the reasons, 
and suggesting where items might be located. " As well, it inform& the user 
Jlf the exact cost, since the latter will be less than that original 1y calculated 
by the requestor due to the missing materials. Materials are prepared in 
the -meantime so that they can be sent immediately on receipt of the cheque* 
Occasionally^ orders for more than $10 have Heen ^received; invoices are 
normally submitted in these cases'. , 1 

In addition to EISO order formg, a form is also included for ordering 
paper copies of ERIC documents from the ERIC Document Reproduction 
Service (EDRS) in the United States (form N(x)) since only microfiche copies are. 



available from EISO. EDRS maintains a large, automated system for producing ' 
paper copies from fiche originals at^p. price well below that possible for EISO* - 
Users are requested to send copies of these forms to EISO, where the data 
will be used for research purposes. . ■ " . 

.. ' / • - • • * ^ ~ ■ . ' * ' ■ ■ " ' • - . ' V 

Financial System ** ^/ ; \.* 2f - ; - 
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If EISO were a fgee service to users," as has •been the case with tradi— 

tiona^information systems, there would be no need for financial' records. 

... ' ■"./■""■ ... . " - 

If one w^dies to charge (and charging for co mp uter, -sear ching of bibliographic 

da t a based is becoming a standard practice in. libraries and information -y 

centres), then a complete financial system is necessary.- Fortunately, The* - > 

* Ontario Institute for Studies in Education's Finance Division- agreed to provide 
invoicing and records* services; indeed, this a T^r^-n^m^rit wa s^ri rfr^al ly v: 
mandated by Institute policy. - ■" / ' 

Funds are paid for EISO services and goods in three ways : cash, 
invoice,, or -cost-recovery. Fpr the first, payments are collected by EISO " 
staff and paid to Finance accompanied by form N(xi), a copy of which/is, 
maintained by EISO. If a user selects to be invoiced, form N(xii) is com- 
pleted by the EISO library assistant,* who forwards four copies to the pISE F inanc e 
Division. The latter assigns an invoice number, credits the ftmdSqde to the ^ 
EISO revenue -account, sends the white .and blue forms to the. customer, re ta ins \ 

- the green form, and returns the pink 'form to EISO. For his part, the user 
becorhes a creditor of OISE (not EISO), and returns the blue copy -^Finance - 

4 with hi s payment. / - .^^ , •* 

EISO users who are students, researcher^, or faculty at OISE may* 
pay cash, or use the cost -recovery system set up by EISO and Finance i 
If they choose the latter, the budget officer in their OISE unit (e. g. , academic 
department must approve form N(xiii), retaining the blue copy, giving the - 

pink copies to the user, and sending the white and green copies to EESOi The 

latter has the responsibility of forwarding the white copy to Finance at month 7 s 



encLT- along with a Summary of Account D% str ibution N(xiv) , a. copy of 
is re tai Tied - In addition^ EISO prepares a m onth 1 y 3 t^te^ ent of Chaj 
each>budget unit; a copy of this is also retained by EISO. 

No formal evaluation of the EISO re cords system has-been un 
. as yet. -When specific problems arise,, solutions^jare sought. Extra 
resulting from the special handling required for customer orders wfa 
t ain requests for copies of materials" not available for copying is a cs 
point.. The present procedures, described earlier, were developed s 
three months 1 , of discussion. While this problem is far less bother so 
previously, it is recognized that the ultimate solution is acquisition < 
missing materials by the OISE Library and a reduction in the! length 
journals are unavailable while being bound or awaiting reshelving. 

v Reports- ^ _ 

Xhe system and subsystems described above also provide raw 
for monthly reports. To date, these have been rather cryptic — nun 
searches (paid and unpaid, Northeastern Region and Elsewhere) and 1 
c revenue. ' After xle tailed analysis *of research data , daily, -weekly, m 
and annual repprts will i?e designed which will summarize what are fc 
key data for managing EISO effectively. Also, so much effort has be 
placed on developing a system that works that there has not been time 
^entrate on matters more related, to its long term operation. One jpo. 
for the latter would be to use the. EISO computer terminal itself for d: 
data entry to the OISE DEC/10 computer'. In tJhis way, reports could 
generated on demand by the search analyst or principal investigators: 
ever, developinent of such a system would be expensive and time coru 
Certainly its creation could not have been considered during EISO T s^fi 
year because a computerized system is ill suited for a system underg 
constant, rapid change." As it becomes mo^e stable during its' second 
though, automation of EISO r s business system becomes a topic for se 
consideration. • r 



Office Lay-out 



Efficient operation requires not only a sound business records system 
but- also an appropriate work area as well. The office lay-out for EISO (Appendix 
O) has been particularly successful. It is located in a room created within 
the OISE Library for this specific purpose. The office is adjacent to the 
tiibrary T s journal collection, ERIC microfiche collection, microfiche readers/ 
printers, diss^tation^collection, and reference area. Hence, clients and 
staff have most original materials close at hand. Indeed, a better physical 

* a. 1 N . ■ 

arrangement is difficult to imagine. Within the office, storage for blank forms 
and file, cabinets for records are close at hand for both the library assistant 
: and search -analyst." Thelatter two are located near one "another , — ensuring ~~~ 
good communication. The only problem arising from this arrangement is 



the occasional disturbance of typewriter noise from the library assistant at 
work while a search is being negotiated by the analyst. 

The. search analyst has a large work area; the only inconvenience 
noted is the difficulty the client experiences in following the work of the 
search analyst' on the computer terminal. The high desk and seating arr ang e- ' 
ment required that the user stand, looking over the analyst's shoulder. A 
smaller round -table, separate from the desk, might be a more appropriate 
location for the EISO computer terminal. 

There are two telephones in the office, one hooked into the OISE swit< 
board and one a direct outside line. The latter is needed to ensure a direct 




linkage with the TYMSHARE computer node mSToronto. Internal lines are 
too susceptible to noise and interruption to be d^endable lioks^r inter- 
active ^computing. < ^ \17 T. 

Fiche duplicating equipment are located away from the EISO office, 
one floor above, with the copying equipment used by the OISE Library. While 
this arrangement requires a few extra steps, it is logical in terms of avail- 
ability of sjj&ce afld placement of other equipment. There was,; in short; . 
no real alternative. - 



Summary 

Development of ah adequate records and information system for thej^ 
management of EISO* a service, production, and financial activities has been 
a difficult qT "^ time cons uming task. Now, as EISO enters Its second year, 
these systems are functioning smoothly. .Previous studies (e.g. , Sieber, 
1972) have suggested information systems have encountered extreme difficulties 
in this field. The project staff took these to hear^t, and concentrated much 
effort upon them. ' Others entering this area should do likewise. 

. Similarly, physical arrangements made by EISO have proven success- 
ful. This was not accidental. Again, the staff sought to avoid problems en- 
countered by others. The OISE Library formed an ideal setting- for the" 
creation of a successful service; such a resourbe is not readily available 
elsewhere. 

For the future, design of reports for regular accounting of operations 
is necessary. A more automated system is also a possibility. Fi n al l y, some 
improvement in the office working conditions, especially with regard to problems 
of noise ^nd Involvement of the client, may be warranted. % . 



CHAPTER VI 



One EISO User f s Experience 



The educator in need of information has m any isour ces to turn to; one_ 



is EISO. If the latter is chosen, the first step is to contact the search analyst, 
currently^s. S. Elizabeth Reicker. The process that follows, however, As 
not quite so obvious. • 

' "• After the initial contact comes the most critical part of the entire 
search service, the "negotiation process" . In this, the user and search 
analyst discuss the clients problem or topic in order for the search analyst 
to develop ah understanding of the nature of the information required and 
- classify it -according to subject headings or "descriptors" winch are "Under-. 

stood" by the computer. 

. : ' •' •• '» ' • '■' / ' ■ '■ ■ '. ■. • . ' • * '.' *. , ,; " , 

The complexity of the negotiation process is such as to warrant extensive 

psychological and sociological study and investigation. How does the user come 

perceive a problem? How Is the problem formulated in the user 1 s mind? 

How is it conveyed to the search analyst? How can the search analyst* by 

using a variety of probing and clarifying techniques, seek to^understand it 

better? How does the search analyst proceed to reformulate her understanding 

........... . . ^ 

of the problem in terms which the computer can understand? Although any 
exhaustive attempt to answer these fundamental questions must ajwait a more 
opportune time, the following example of an actual search request, interview, 
and strategy formulation is presented to assist an initial comprehension of 
of the process. 1 



Description of a Search — S. E. Reicker and- Jane Smith 

Jane Smith telephoned on January 20, 1976, to request an interview 

to design a search strategy. During this short conversation, the search analyst 

learned that the subject of the search was "repayment of student loans through 

service to the state". The date for the interview j/as set for January 22. 

i 

Before the appointment/ the search analyst scanned the literature on student 
loan programmes and identified problems in the search. The entire face -to* 
face interview was tape recorded for research purposes; examples of conversa- 
tion in this chapter aire taken from the transcript of the tape. 

Because on-line bibliographic searching is a new service, it is neces- 



~ sary~ to reassure fir st tim^ 
does. It is found that ah informal approach is most successful — answering 

^questions rather than lecturing. As a consequence, many activities oacur ; 

simul t aneously — definition of the topic, explanations about ERIC descriptors, 

the size of the ERIC database, Boolean logic, computer searching, etc. Some 

time is also spent with the client in explaining the function of EISO and giving 

directions for ordering •copies of microfiche and of journal articles. 

\ In the case discussed in this chapter, the client has already started 

looking for information on the topic: 

Search Analyst : Hate you done any research on your own or ... . 

Smith: Well, I started off on the EltfC stuff that the Library 

h as and then I was speaking to a librarian there, and she said 
^ you had this, so then I thought weljjp-you know, why bother when 

I can do this. - 

Search Analyst : Did you find .anything when you were going through 
on your own? 

Smith : Just a couple of things, but you know I hadn't really . 

These are the descriptors tl^t I've been looking under so that's — 
now^these are a couple that I did find : - Non-traditional college 
routes to? careers , 

Alcnough Ms* Smith began the interview by asking some general ques- 
tions about EISO — how long it had been in operation, hew- many fisevs ha d 



tried the service — the search analyst almost immediately assumed the role 
of negotiator by summarizing her perception of the problem and what she had 
discovered. A dialogue about the topic started then and lasted for approximately 
30 minutes* The search analyst was trying to understand the information needs 
of the client to design the best search strategy. 

Smith: well, not necessarily social, but service to the state 
of some kind. v 

Search Analyst : Undergraduate students? 

Smith: All levels, any level at all. Most student loans are given 

at universities, that's what I mean; not especially high school r% 
students and summer jobs. You see, one of the things that 

v - — could be involved is that in many-countries study-aid is given — — 

after the age of school leaving . . . Student aid doesn't neces- 
sarily mean student. It really should be termed study aid so 
that yoii ate. studying any time in your life, ... so long as you 
. are prepared to give some service to the state in return for ' .? 

V - .'it . ..>. - , , • ^ • ■- 

Search Analyst : Is it the same as management development in a job? 

Smith: If they would take people from graduate school and put them 
into ah internship program in some of the state agencies . .. 

' Concurrently with this negotiation process, the search analyst was 
giving the user information about the ERIC system, in particular the descrip-* 



tors in the Thesaurus — and the Broader, Narrower and Belated Terms. 
The search topic was discussed.! 
access points approved by ERIC . 



The search topic was discussed, in the descriptor language to try out^the 
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Search Analyst: Work study programmes are programmes provid- 
ing part-time employment to, students who need financial aid in 
order to commence or continue their education. That sounds 
pretty good; / 

Smith: Do you have something^ theT The Taurus like day release ?- 

Search Analyst : That sounds like prisoners. . . . Day release — v 
"time u&^i fox day release" — it* s related to off-the-job \- _ 
training, ^employers-employee relationship, school -industry 

relationship, time block ... . .' 1 . 

\ ' ; - . / ■ _ . ■ ■ ' •'• '* ■ ' * • - * ..■ v. '• 

Sq^thi^rd lik 4 e time blocks too . . . W'" * 
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It is evident that although the user is the' expert in her field and is most ' 
aware of the terminology, the search analyst plays a major role in choos- 
ing the access points.for the search. In this example both were able to see 
"the plot thickening" in the search for elusive information. 1 Because Ms. 
.Smith had started to search ERIC manually and was familiar with literature 
searching tools, the search analyst assumed that she wanted to take an active 
role in choice of access points. * ^> 

Two advantages of computer searching are stressed — the speed of 
the search and the ability to access many parts of the bibliographic record 
(authqrs, institutions sponsoring research, programme names are only some 

>les). - The combining- of^ the different access points chosen by^Boolean — 
I *\" " 

logic often illustrated in terms of the search request: 

Conjunction: 50 ref- 
erences indexed by 
both descriptors 
*AND^^ if shaded area)^ 

The possible results of the search are discussed and alternative pro- 
cedures are planned in the event of too much or not enough information. 

Smith: I have a dreadful feeling that it is not going to be very 
much. 

' Search Analyst : I tend to agree, but we can see if the references- 
• retrieved by the cchi junction of student loans and cooperative 
education proye to be relevant. ' m — 

By the! end of the negotiation process the terms t£ be searched are 
listed and retrieved by both the user.and the search analyst. Additional 
words anicTphr as es which might help in the search tut which are not listed 

" J a 

• -v ■ , „ i 

as descriptors are jgonsidered. 

: \ ~. Search Analyst : Has it been, tried anywhere else? 
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Smith: Saskatchewan has something apparently and I'm just get- 
- ting some information on that, ... a system in Australia 
apparently called Cadebships which are offered by the State, 
and then the state would pay you to go to school, . . That ■ 
was tried mostly with teachers, . . .Well, listen, there's one » 
thing I want to know more about: the Canadian Forces system. 

The final choice of terms was as follows : 

Set 1. Cooperative programmes, internship programmes, work 
experience programmes, work study programmes, released time* school 
industry relationship, employer-employee relationship. 

Set. 2. Adult education, external degree programmes, part-time 
students, ^^ening students, evening college, independent study, university 



extension, continuous learning. 

Set 3. Student loan programmes, scholarship loans, Saskatchewan, 
financial needs, financial support, student costs. 

Set 4. Cadetships, ROUTP, ROTC. 

Due to other commitments, the client unfortunately had to leave at 
the end of the negotiation period, which meant that the actual search had to 
be done in her absence. Because of the lengthy interview with the search 
analyst, Ms. Smith was nevertheless confident about the search stragegy 
chosen and not hesitant about leaving the problem in the search analyst *& 
hands. 



Smith: Well that's splendid^ let f s hope something comes up. 
... smashing system isn't it? * " 4 



The search was conducted the next morning (Friday) against the ERIC 
data base using the Sr Z computer system's ORBIT software. The fears of 
the user and the search analyst were confirmed. When the three main sets or 
groups ^of items on cooperative programmes (1), acKilt education (2); and 
•student loan (3) were combined together only ten references were retrieved. 

In some cases, that number wo^ld have been adequate for the user. "* 
However, Ms. Smith was starting on a yeaj^s project and had been assigned ♦ 
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the task of developing a programme; therefore, more Information would be 
necessary. The search analyst decided to broaden the search. 

Group 1 (cooperative programmes) was linked with Group 3 (student 

loan programmes) to produce a set containing 95 references. Although this 

* • ■ - 
figure was a manageable number, a scanning of a few of the titles. did not 

show them to be particularly relevant, for example/ "Guide to Operating an 

Off -Campus College Work -Study Programme" and ,f A Model Internship: The 

Intern - — An Economical Assistant". " 

- . At" this point the search analyst used her knowledge of the client's 

problem to determine the types of references which would be useful in her 

"V . ■ * ■ - t ■, ■ 

search7~~A;look at the 
that it would not be easy to eliminate citations of documents and articles which 
were of. marginal relevance. 




(Set 3) 

dent Loan \ 189 References 




'Programme J (shaded area) 
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When the 'references retrieved from this set were added to the match of student 

... _.-»*•- * .■ * 

. m '** ~ • • * ■ ■ ■ 

loan programmes in adult education (95 references), a total of 272 references 

was retrieved. These were limited by a group of descriptors to indicate a ^ 

level (e.g., higher education) or a non-rdescriptive paper (e.g., literature 

reviews, research). This additional combination narrowed the retrieval to 

80: references. W : . ■ ; . : 

A search for references on ROTC and Cadet ships yielded seven, i^ms. 

These were added to the 10 initially retrieved and the 80 of potential use. 

The final set chosen for off-line printing contained. 95 references. 

,■ - ♦ 

. The full citations, including the abstracts and descriptors for these ~ 

95 references were ordered quickly and efficiently from the^SDC computer 

centre in Santa^Monica, California. -In this case the printout was sent directly 

to the client's office/ The entire computer search lasted only 14 minutes. 



When the search was completed, the search analyst filled out the form 
letter (Appendix N) and sent that as a confirmation to Jane Smith. The form 
letter was accompanied by a written explanation of the printout, order forms 
for the documents, and a copy of the search request form (Appendix N) . Bach 
' user is encouraged to seek the help of the search analyst in the' event of 
questions or problems. 

On Tuesday morning, only three days later, Ms. Smith telephoned " 
the search analyst to. report that the printout had arrived. They -discussed 
the procedure from that point and decided that she would become familiar with 
the bibliography and focus her research design before ordering microfiche 
- copies . Many of the jour nal articles are available-in her own library and would 
be ire ad or photocopied there. 

Three days later the client telephoned to request a second search. 
Though dealing with a new topic, the interview was conducted over a telephone 
•in five minutes. The search analyst 1 spent another 10 minutes designing the 
search strategy and then processed the "request in the same manner.. 

Ms. Smith was sent an evaluation questionnaire in early February* 
Although the client has hot yet returned the completed form, the fact that she 
completed the* search cycle twice, clearly represents adoption of 
this innovation, namely "the EISO information service. 



CHAPTER VII .. t - 

Information Systems Model for the Assessment of EISO 

* . 



The viability of the Educational Information System for Ontario (EISO) ... 
depends on the people it is designed to serve. To asses s^ttoe viability of the 
service we must know a great deal about its users* Who are they? What are 
their information needs? How can they be satisfied? Are the needs great enough 
to create and sustain demand for inforrnatiori services at a price that will pay for 
^the full cost of these services? If these questions can be answered, we can 
assess the viability of the information service operating in a given context, and! 
describe how it can operate in an efficient andreff ective m&nnerl 

A systems approach is used to organize the multitude of factors which 
must be considered if the questions raised above are to be answered^ "> : That is, 
input, process, and output variables mtt^t be treated separately, with it being 
assumed that the first. two types of variables serve, at least in part, to explain 
the third. Data collection for this purpose was limited to a pre-coded questionnaire 
completed by each user for each search (Appendix C), and a more cryptic data 
sheet (Appendix D) completed by the search analyst and research officer. 

This chapter focusseS on the explication of the information systems 
model used to organize the data that were collected. This systematic treatment* 
of the information search cycle is then set within a framework developed from 
the literature on the adoption of innovations. The view is taken that the Educa- 
tional Information System* for Ontario constitutes an educational innovation in 



the province* and tl^at its use by an educator represents that individual's adop- 
tion of an innovations^ namely, EISO. The following chapters describe in detail 
the data collected, the findings based" on the first five months of EISO v s opera- 
tion, pad the implications of these findings^. ' 



Information Systems Model 

Thtf Educational Information System for Ontario is a service seeking to 
satisfy the information needs of its users* One cannot study the service without 
.considering the users. It is their interaction which results in the goa/being 
reached — the users learning wh^Lt they sought to know. 



In a sense, then, a broad View of an educational information system 
encompasses both the user and the service, the user being characterized by . 
unfulfilled needs and the system by its ability tosatisfy these needs ♦ In practice, 
a user's needs would berrepresented Bjpa verbal or written request for informa- 
tion on some topic, while the information system would be personified by the 
search analyst, trained to refine the requests so that existing information on a 
topic can Be. retrieved for the user. After a request is submitted, the search 
topic is .^negotiated" by the requester and analyst. Then, appropriate references 
are retrieved and later the documents themselves. From the information 
scientist's viewpoint, the entire information search cycle maybe said to end 
here since information has been supplied to the client. However, stopping the 
process at this" point begs the question as to the system 1 s success in actually 
satisfying the information need. Has the client's^ need for information been 
satisfied? Therefore, we must consider that supplying documents constitutes 
a stimulus which helps users to acquire knowledge and thereby . satisfy their 
information needs. To be sure, th6 process can be carried still one step fu^fcher, 
to the application in practice of the knowledge gained from the documents v « How- 
ever, this step^carries us one too far — beyond the uisers to their social environ- 
ment. We choose to omit this step from study, not because it lacks importance 
(it does not), but because it would expand the scope of the investigation far beyond 



that required to assess the viability of an Information system and would change 
its character into one having the educational system, rather than the user,- as 
its focus. It seems far better to consider that satisfying the 'user ?s informa- 
tion needs — however subtle a transformation -of the user's state this may be — 
is the best point to conclude the information search cycle. 

At each stage^of the search cycle — composed of a search request, ques- 
tion negotiation, sea^eHL reference retrieval, document retrieval, and knowledge 
acquisition — feedbacj^pcurs. During qug^on negotiation the search analyst 
makes inquiries of and suggestions to the user related to 'the search request, 
and the user responds ♦ After a few references have been retrieved and reviewed 

■ _ * _■ ■ _ _-„■; ■ ■ ; ' - _L. ' -.J. ' 

by the user for relevance, negotiations may be rebpehjed and an altered search 
begun. The cycle of stimulus-response-feedback recurs constantly until the final 
: set" pf references is retrieved, Even.-at the end of the entire cycle, when a ^. - 
satisfied or dissatisfied user has ended the. search process or ^turned elsewhere, 
feedback to the information system' continues; The former us^rs, acting as 
disseminating agents, recount their experiences to others, thereby creating 
expectations that are brought to the system when new users make search re- 
quests. Dissatisfied users, by their negative comt^As, .mayjaffect the system 
by reducing the expectations and even numbers of u^^s* More directly, through 
formal evaluation forms, all users have the opportunity to provide feedback 
designed to alter the form or operations of the system. 

The cycle of activities, together with the user, search analyst, (com- 
puterized) retrieval system and their special characteristics, form a system * 
which is\ portrayed graphically in 'Figure 1. 



) 



FIGURE 1 / Information System Model 
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Models of Behaviour 



Systems models are particularly helpful in organizing the questions that 

• - 

can be asked about a particular situation* Questions concerning the user 1 s - 
characteristics come first, along with, those concerning the search analyst and 
the particular techn61ogy being used to actually retrieve information. -Next come 
those related to the process in which the user is transformed from an individual 
lacking in knowledge to. one who is informed; finally, one can consider the end 
result — the level of satisfaction, the types of documents retrieved, etc. At, 
each stage one can investigate the nature of feedback occurring. Throughout, ~ 
questions may be on a micro scale — focussing on the individual user and his 
or her interaction with the service " or on a macro scale, with data being - 
aggregated to develop an overall picture. 

Because 'the purpose bf this study is to answer questions related to the 
viability of the Educational Information System for Ontario, aggregate data are 
importantr-^How many users are there? How many potential users? How 
satisfied are users on the average? How much revenue can be generated — 
enough to cover expenses? Aggregate answers, of course,, are based on in- 
dividual responses; .ideally, the investigator assembling aggregate data knows 
as much about each individual as does the micro researcher* but this is never % . 
the case. In the place of collecting extensive information about each subject, , 
one can decide^ (or assume) all subjects act ur accord with some set of laws — 



sociological, psychological, economic, or whatever" — and then only collect 
data for those variables related to the theoretical model being used. It is this 
latter approach that is used in this study. _ 

» - ■ . - . 

< Sociological ' 

A sociological approach to man would view the user as an individual % 
occupying some role (or set of roles) and status position(s) in society. In most ' 
cases, a user will hold ^professional position in an educational organization, 
and his expectations for his own behaviour based on his interpretation of organi- 
zational norms will likely account for his decisiob oh whether or not to make an- 
EISO information search. If he believes that searching for information is a highly 
valued. activity in the organization, he will likely conduct a search. If, on the '., 
other hand, he believes it is* considered unproductive he will not. 

As well^ an individual's ^role may even determine if he hears about^EISO. 
Graduate students and administrators have been sent brochures .advertising 
EISO; teachers and^ undergraduate students in education have not and must * 
depend on their superiors' to relay the information: ' 

An individual's social status is another variable of importance!— Those 1 
in higher positions, with more power accruing to thein than those in lotver posi- 
tions, are probably more likely to seek information because they can put it to 
use; , their decisions count. The same cannot be said for those in relatively 
low positions within the status hierarchy of the educational profession. 

Finally, the environment of, the organization in which a user works will 
condition his approach to seeking information, as well as the type of information 

9 

sought. "Those located in urban areas are likely to have information centres 
readily available — and a surplus of critical problems in need of solution. 

\- - - \ Psychological . 

A number of important characteristics of users are essentially psycho- : 
logical in nature — pne's knowledge about a topic, motivation to learn/ i 



,. ■ • <- - ^: ----- ,. 
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r attitudes toward innovations in gene»3|L and opimobe ai^t^BgO An 

particular. . .. - ^ - ■■ ; ■ -.m \\ : • ■■" 

h ■:/ - '■ " \ - " '■- * ' "■" . - ."- V " " " :\ . ■ " / -. : \ ■ 

.-' \ Presumably, an individual must have some krraj^ledge al^ut a topic 

before a question concerning it can be formulated. If a search is undertaken and' .> 
y * additional information is located, then learning can occur^and thie incU.vidual f s 
^ need far information is reduced. Thus* learning moderls provided by psychol- \. - 

ogists are of considerable relevance to ElgO's performance. 

The user's motivation to learn is clearly a major fbi^ ^^ecting the^ u 

decision to Search for information. One motivating f actor;, may b :• the individu^^ 
^ '^need f or acMevemefit^L Information may be -sou^t in order to assist the 

person* s social advancement. Knowledge can be power. 

At the same time, the personls attitude toward innovation and change ?nay 

be of critical importance. Those favouring old ways are not nearly so likely to 

try a new service' such as that provided by EISO as those who have a predilection 

toward new ideas, products and services. 

'Finally, a user T s opinion about EISO. — his satisfaction with the quality '" 

of the service and information provided -r is essentially a psychological char- 

adteristic. ,In ass€*ssing^the results of the information system, „ these, opinions are 

of major importahce. :.• ~ ' I- '* . "> ; ■ \. 

c ; " ^ - . ^ • \. Economic- ' ■ -J?-"" 

The long-term fiscal viability of EIS<5 is primarily an economic question. 
: "if one 'assumes the system must.be totally self supporting, then there are three 
economic^ models that can be applied to determine the^>robable : answer. The ■'. 
: findmgs would arso be of 'value in developing a policy which would incorporate ; 
partial subsidization of the service. ' v .-2 l ;'/ r 

" Th^}price-rdemand model views the user as an individual ' with limited T 
funds who makes fiurchases iaccording to a set of priorities,^ r with the ;amcmnt 
purchased of a^given product (of a g^ \ 
Applying this mo^del to an information user directs the investigator .to collect; ^ > 
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data rdfeted fo-price and quality of- the information search; service, and the" quantity 

- ' -.* v -", ' . ■ ■ • '■■ -- m : ' r'"»4 • - 

purchased by users. Other types of ec&^omic models, e»g. , a co'st^effectiyeness, 

cost-bfeiiefit, etc., would T requir0 T collecting other types of data. 

• -9 - . * ' ■'§.' - - '.■.*'■■ 

• ■ ■ ■ . • ' . - "A- ■' ■ . * ■ . r • . * . • - 

Cost -effectiveness analysis re^qs?es data on system processes (especially ' 
cost) and results, to establish the relationship between the cost of a given approach 
with the quality of the product resulting from various processes. One might com- 



pare the cost effectiveness-6f supplying paper copies of documents with micro- 
fiche copies, first collecting data on the- costs of each^and then on the extent to ^ 
• which each satisfies the information rieeds v of the user population^ One might - 
find that, though microfiche were only half as effective as paper copies in satis- 
fying information needs of an individual, they were five times as cost effective 
because their costs were one -tenth those of paper . That is, in lend ing out the 

same dollars 1 wor . of microfiche and paper copies (say 10,000fiche and 1000 

• • •• .' .. '- . ■ ' . - ■■ . v . * 

paper cppies) and assuming paper copies wer&*-always effective, the first option 

^ would produce 5000 -satisfied users which the second! woiild-g^eld only 1000. 

Cost-4>ehefit analysis is similar to cost-eff ectiv^ne ss^ but more inclusiye ' 
>* in' its measurement of results. In the present study, a cost -benefit ^analysis v 
would require an estimate of all benefits or* "goods" arising from a single search. 
One would have to estimate, say, how many children with a particular learning 
disability* would be identified and given. proper irreatment — thereby enhancing •/ * 
their entire life, and ear ning ability-'-~ as a result of information searches. Less v 
m ambitiously, one might try only: to Estimate the .number of "secom readers" a 
giwii IRisn hiblingrrapliy might h^v^j and to place a dollar value on this occurrence. 
Regardless of the. scope of- estimates of benefit 

* remains highly specixlatiye, more ?o than either — ;cosj!-effectiveness {and < 
effectiveness is rarely measured with very much precision) or price-demand 

jls. . -7- : • ■ - <: ' . • -V : . ... \ 




Three general perspectives -or approachs, socibiog^cal, % psychijSdg^pal^ . \ 
and economic, can guide the selection of variables and collection of^daraE:through- 

out, the inf ormatioif cycle, from the initial search request to the concluding 

. : . 0 r " • - ■'" :v ' ■ • " - ^ 



actjuisition of knowledge by the user. Data' can be ] collected on the thi?ee /'parties" 
involved — the user;* the ii^rmediary, and the retrieval system itself — and. 
can be aggregated to describe the characteristics of the user population^ e.g*, 
its average levelrof information; need, and the overall information system, e.g* , * 
its cost. Before developing detailed rationales for the selection of specific ' 
' variables for measurement, as well as their definition and opferafionalization, S 
a wider view of the Educational Information SystenFfpr Ontario must bfe taken*^ 

^ ; Adoption of Innovations ' . ; 7 v ^ . , , 

To this point, our discus sion has implied that the Educatfo^ 
tion System for Ontario, EISO, is an existing service with a regular clientele. 
This situation is not, of course,^ the case; instead, EISO is a new, experimental 
service which may be viewed as an educational innovation rftaking its first appearance 
in Ontario. This particular context means that the system has no^! f users", just 
potential users. This situation is rather like that when a nevy variety pf influ- 
enza appears — no one has been Strieker^ but there are many susceptibles . ^ 
(Lawton & Lawton, 1975; Rogers, 1962). , / 

Treating EISO as an innovation whose : adoption has just started requires * 
incorporating tli^inforination system modeV (Figure 1) pato a more geners^ , ■ 
mqdel which incorporates the stage of adoption experienced by an individual 
coming;into contact with a new idea (Rpgers, 1962) : ;~ 1) -no knowledge, 2) 
awareness, 3) seeking of additional information, 4) ^rral^adoption, 5) e valua- ^ 
tion, and 6) permanent- adoption or rejection.. ■ *j ^ ; # ^ 

At the start of the EISO project (March 1, 1975),, none of the potential ; 
users knew of the service since it c&d not exist*, all Were at stage 1. To be-r 
come a first time user {stage 4), stages 2^ and ^3 must ; first- occur. In the case; 
of EISO, where the search analyst is the major source of. additional information, 
stage 4 often follows immediately after or in conjunction with stage 3, seeking - 
additional information. After trial adoption (stage 4) , evaluation^ (stage 5) occurs. 



Evaluation by the user is inevitable; people form opinions and attitudes 

• - v ••: ••• 7 ■ * / * /~** • ' " ■■* -. 

after any netf experience. Clearly, this assessment by the first time user is 

* all important to the viability, of an information system, since 4 it is*tbis evalua- 
tion which sets the value (in economic, and professional tetms) of the search 
service in the user's mind". If his information need is satisfied, it is likely the 
service will be^yiew^d positively, though if the information contradicts his own 
belief s or opinions, he may blame the messenger and for^n a negative opinion of 
the service. Or, if the search negotiates* has revealed the^nser's naivete and. 



ignorance, he may feel-humiliated ana avoid further j?ear ches . R^artffjgss, *r ■ • - ^ 
a final decision (step 6) ne ce ssarily occurs : permanent r e j e ctibxQtor regxiihess \ 
to use the service again whenever the appropriate circumstances arise. - " 

The innovation adoption model adds a degree of complexity to the overall 
design of this study. Gleiarly, 7 fi-rg* ±im& * nwr wlin ^rnplgfog an information 
search cycle has* made a "tria|^adbptiori TT of the EJSO service?; the Sfigond time 
through the cycle represents permanent adoption of the service. Hence, first 
time and repeat users of the ^system must be treated separately. In addition, 
thk population of users must be broadened to include . all potential users — : 
i. e. , "those susceptible to the- innovation - and l!he systeins model that is used 
" to guide the collection of data, must be ^ eisrtended- to, incorporate . an awaxeness ;~ - 
phase. The model then becomes, more escpHcitly, an open-system model (KatZy 
& Kahn, 1966),; with "awareness" representing a chaxacte^ 

present) of the potential users of the system. Upon completing the seai«£frpro- 
cess and utilizing the documents,, users themselves spread knowledge ^bout 
the service to other potential^tisers until all are aware and, ultimately, become 
at least trial users (Figure 2) . > £ • 
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^ Since the rate of diffusion for recent educational innovation tends; to be high 

7 ^Lawton & Lawton, 1975), it can be expected that within five to seven years, 
: all potential user s will have tried the information service, and the? overall 
system-will approach -a steady state of operation* V r - 

-Parenthetically, the adoption model for innovations suggests one reason 
for expecting potential users to place a relatively high value on the service: 

" namely, collection of information is a key^step in the process^pf adopting any • . 

;new practice. Thus, it can be expected that users particularly" users in th 
first two years) will be the types of individuals who axe given to trying out 
innovations (Rogers, 1962; Carlson, 196^5) . They will probably be involved in 
stelectfhg other innovations, and will likely turn to EISO as a convenient source 

X .of additional information. F uxther more, the, fact tha£ collection of information 
is a stage in the process of making all types of decisions (Musella, 1973) 
suggests that most educators are potential users of the information- service. 



Summary 

The viability of the Educational Information System for Ontarie depends 
• - ". ■ ■ • " % "'. ■■ . ' 

on the willingness of the educational community to make use of the system, 

. ■ V 

paying sufficient fees to sustain its continued operation: ' To learn 4f this support 
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is likely, this study has, f dcrissed oil EISO users, treatment t>f them as social; - 
psychological, and economic individuals; in particular, their role in adopting 
EISO as an educational innovation is considered. These various viewpoints are 
organized into a systems model of the educational information search cycle set 
within an innovation adoption model. ^ > • . V • / - 

The next chapter turns to the coUection of daia related to the topics . / 
noted above. Variables describvrig the users 1 social*rble, phycHological" ; * 

characteristics, economic behaviour and satisfaction with EISO are treated 

\< <V - * - - ■ 

-in detail. N - -: v / * .v. .i'v ■ 
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. " ' CHAPTER VIII 

The EISO User's- Questions, Definitions, Variables, and Satisfaction , 



-a 



x 



Who uses EISO? WhaTab^^eir information ^ Are they satisfied 

with EISO? r^ese are three of ffte^fvuidamental questions which this study seeks 
to answer. : EachJ^nels multifaceted and can be approached from several dif-^ 
fereht jteri^fecns^esi In this ^chapter, definitions of Jthe dimensions of .primary 
relevance In ^ris^ering^ these questions arejp^vided, followed by the particular 
item(s)" used- to assess the user's place on these dimensions* As noted earlier, ^ 
two data collection instruments were used: - the^EISO-User Evaluation Question- 
naire (Appendix Q and trie EISO Service Evaluation D^ita Sheet (Appendix D). 
Throughout this chapter; items frtfm th^two forms are identified by the item 
y^umbers that appear on the forms' thems^iyes^ though they do not appear in 
the same order . Items from the questionnaire are identified b^ifumber (e.g. , 
itein 17) while 'those frpm the data sheet are identified /w/th the prefix DS 
(e.g., item DS17). 

The three persjpptives'used in this chapter to view the users are those 
described previously; namely, sociological, psychological, and economic. 
Among the psychological variables is one of considerable importance: the 
user's satisfaction with EISO. . 

"Sociological Perspective 

The first question! 11 Who uses EISO?"i' is* most readily approached ; \- 
frbpr a sociological viewpointv In what type of bir^nTz^jlon is the user emr g ;v;; 
ployed?", What are the person's^ r^^ 



is the organization^ environment? These questions address the four types of 

^v:>^^-;.^ s ;-A;.;,: ; -r : 



social variables that must be considered. 
Type of Organization 



. Probably the most important social systems f or EISO users are tie 
4 formal organizations within whfch they work -r- school boards, faculties of 
education, or whatever. These organizations, most of which will be non- v - 
profit in the casSsjo&EISO users i have Specific goals (e.g. , Jto educate children), 
and maintain well-defined roles for their members; - These roles are defined 
in terms of the behaviour expected of tbe; individuals, i^ 

are mandated fevg. , a«teacher must teach) , permitted, (e. g. , a. teacher may .*■'. 
suggest new policies) and forbidden (e^ g. » :a teacher may not, hire staff). For 

;'virbti£l^'all roles, in educational organizatior^,^ 
permittee^: ^ and^for some (e.g., researchers, graduate students) it is reqt^ed; — 

/i. ei. , it .is ejected behaviour on their part by rboth themselves and : other members; 
of the organization. A person* s role, in all probability, wilT to a large extent 
account for whether or not he will try EISO. An OISE graduate s^dent, ^studying 
and searching for information in the same building in which EISO islocated, 
is extremely likely to use it. A distant elementary school teacher involved/ * 
primarily in classroom teaching will probably not use the service, unless- j 
another role she occupies, such as that of math curriculum committee member, % 
includes the expectation that information will be sought for the committee's- 
use* This latter possibility suggests one of the difficulties m using a person's 
role to explain his or her behaviour: people have multiple ^goles, and it is 
difficult to know which role they are playing when undertaking* a given action. 
Indeed, in the example above, the teacher might request information concern— 
ihg math curriculum to satisfy both a classroom need and a committee need. 

- In practical terms, types of organizations with which users are primarily 
associated are determined by their response to items 1 and 2 on the EISO User ; 
Evaluation : Questionnaire" (Appendix A) . Categories include the following tjnpes ^ 
of organizations : preschool, public board,/:Separate board, private school or 



board, college of applied arts and technology ( CAAT), faculty of education or > 
teacher 9 s coUege, university, Ministry of Education, fferofessional organiza- 
tion, government, and business or industry. 

For school board personnel, and -in particular those serving in schools, 
it was felt that the size of the organization might be an important factor related 



to the amount of information needed, the assumption being that large organiza- 
tions are more complex, making the need.for information greatey I Therefore* 
; both the board enrolment (item 11) and school enrolment (item ^2) were requested. 

Professional Role \ . ^ 

• . - v The user t s three major professional roles were dete^Lined by their , ; Z 
response to item 6. A limit of three roles was imposed somewhat ^bitraxily ^ " 
for the sake of economy, with the primary, secondary/and tertiary roles each - 
being identified. - Included in the choices were administration or supervision, 
% teaching, , pupiL persojonef services^ research, field development, Ministry of • 
Education regional office,: library services^ private consultant, student, and 
other. The student category was broken down by level ; undergraduate, M. Ed; , 
Ed.'D. , M. A. and" Ph. D. . v ? -. ■ : - . 

■'' For school board personnel, the professional role was^also modified c 
by' level: . elementaryjjrades only, secondary grades only, elementary and ^ 
secondary, central board office, and other. ~ . - ■ V 

.As suggested in a previous example, the type of information individuals 
>3eek and the frequency with which they seek it are likely to be related to their , 
♦ professional responsibilities. Indeed, information seeking is azuexce e dingly 

important prdfessionaLactitfity which is part of the expectations for many roles.- 

■ ' . ?i 

In addition, it is a characteristic of utmostrimportance for the user of EISO. 

Therefore, item 19 asked how often (never, sometimes, often, or very often) 

' - . . - : . . - ' ■ ■"' -•' ■ • ' - 

they^ought information for each of the following purposed : to keep abreast of 

their field; to complete assignments, term jsiSpers theses; to prepare or 

update bibliographies; to develop, curriculum; . to improve programmes; * .to* v :-\ 

prepare speeches, jreports or articles; to ^mplete ^ 



projects;, fo browse; i to recruit or evaluate personnel; to develop policy and 
to meet other needs. ^ / - : : , . <t 

The sources of information used to meet these various. needs were - 

identified in item 18, which asked for an indication of the amount of time per ' 

•. J - ■ - " /\ . " V " ^ 

weekj spent using a given source, - As well, the value (lojv, medium, or high) 

r j ^ r . » . ...... 

of tne information acquired from each; source was requested. The list of sources' 
icluded the following: colleague^, professional journals and books,- outside ' : 
consultants, inside consultants, off ic^filps and records, supervisors, profes-" 
sional organizations, libraries, conferences, professional development days, ,/,/, 
academic or professional coiirs<es, » ^ujrricj^lum guM^S or texts, EBIC materials, " 
educational abstracts and, indexes, ;and opier. r : " V f 

The purpose in requesting a parttcular- ElSb "search is also rooted in 
the individual's role.* Recorded^fi the seiar,ch r^^st form, this irrfoxmati on ; • 
was coded onto the EISO Service Evaluation Data Sheet (Appendix D) as item - 
^DS4 using the, same classification scheme us^ti for noting their usual reasons * 
for seeking information. Related to the purposfe of the search request is the 
amount of information needed, a matter tapped by* items DS6 and DS7 : first 

year for which materialsare required (a recent year, implies ;S*Qt little material 

. . ■ * ■ '"*"■■' . . . . "j * - 

is required) and'the- number of references desired. V * ■ ■ . 

Organizational roles are not defined solely from 1 the institutional per- 
spective, of course. There are unique aspects of an individuals behaviour and ^ 
expectations regarding a role that are not shared by all other individuals in the 
organization even those in positions that carry the same name. Certainly, 
not all teachers, not even all grade 3 teachers, teach the, same way. Similarly, 
>not "all are likely to have the same information Bteeds. This kriowfedge and 
expectations derived from professional training (e-g., completing an M.EJd. 
programme), experience in the position, professional activities and reading 
habits might .aH affect an individuals performance ip his or hefr-prinriary pro- • - -f 
Sessional s roljs(t Complementing ih ^nstitutional dimension 1 of ^ganizktioiial 
roles^xs the personal dimension chara<sfce/rized by the f oUowingJLtems : }■ ' / 



person's highest degree V- high school^ teacher's college, b^jdhelor^s,; masters, 
(item 55); years in ^current position (item 7); experience as an 




officer of a professional organization (item 13) ; extent of publications and 

conference presentations {item 15); membership in voluntary prof essiona 

■ - ... :■'■■.'*• • ■■" " --■ ' v - W- * - V ■ 

organizations (item 14); and participation in research projects (item . 



Social Status : • u * * " T; ^ ^ ^ 

* . . % -. r 

A persons social status will: also be an important back^ound variable 

related to his performance on the jobi On any normal scale of social status, 

'..->■" ' "p* ' r - r - ' *. " 

of course, virtually all of EISO T s users would probably be classed very highly 
since most would be liniversity^^raduates _ working in professional positioqs^ 
.Nevertheless, the status of ^uidividuials'of different ages dnd sex does vary, ^ 
with mature males *(up to" retirement age) usually of highest stafeis, "with the 
most power and prestige, arid young females at the bottom^' with little v ixifluence^ 
or prestige. Therefore-questions regarding >oth the User's age' (iterh 52) and 
sex (item 53) were: included. 

That Social ranking by r age and sex exists (and is apparent in school^ 1 
systems wherein virtually all administrative positic^ns are held by men between 
the ages of: 35 and 65) does not imply that the situation is fair or* unchangeable. 
It simply represents ja current social fact. v 

Organizational Environment 

: After taking personal differences into account, individuals occupying - : - 

\ -: «* ' ' . • 

similar roles in different organizations might be expected to have similar ; * 
kinds of information needs^ In fact, though, environmental factors might also : - 
cause their information needs to differ. For example, one administrator may work 
in a homogeneous rural board while another is employed in a heterogeneous 
.urban setting. The two might require different types of information in order 
to solve problems arising from their boards 1 different social environments. 
A s imil ar situation: applies for other types of roles and organizations. One . 
particular factor ~of importance is whether, or /"hot the organization is ^ocated 
ii^2x£ Ministry: of ^Edu^^ionfs Northeastern Begion centred in North. Bay o 
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This 'region is the test area for- experimentation with specially trained Educa- 
tional e lnforrnation Consultants, thereby making^it special when compared, to 
', other regiofrs in the province. . Four items tap the environmental conte&t, one 
of which (concerning language) only applies to boards and schools. Item 3 
- inquired as to the^fnunicipality in which the user's organization was located: 
a district or district muni cipality, a county or regional municipality,' Metropoli- 
tan Toronto, Ottawa, London, Hamilton, Windsor; Sudbury, Canada (outside 
Ontario), and outside Canada, 

" Whether or Onot it was located in the Northeastern Region (Region 3)T ^ 
was learned from ^tem 4; the^ urban or rural.nature of th^setting was : sought 
in item 5; and the mother tofrgue^of the majority of students (in the case of 
-schools) in item 10. ' 

j y Psychological Perspective - _L ^ ^ 

-^...7; - ; Describing users in sociological terms has led us to consider them 
. first as; members of organizations, second as incumbents in particular roles, 

having, both institutional and, personal dimensions, and third as individuals 

^ ' ; .'/>,-.. , ' ' r : — - • . •: ." . -' 

\ occupying: some portion in the social hierarchy. .Finally, the important social 

context of the organization itself was noted. * Jtfext we shall answer the question 

of who EISO users are in psychological terms, -first viewing the user as a ... 

learner, and second as a subjective being with particular motivations, attitudes . 

and opinions. \ , - • % f> 

The Usier as Learner ' ~ . v ■ * . v % . ' ' - "> ^ . 

^ j . 7 " How does a -person learri? What conditions ^re; necSessary f orTltearning , '"" 
™ to take place? There are many the brie & xsonce rni ng each of these questions, 
some 5 are consistent with* one another, and others are cpn^tdictory. It is prob- 
ably- fair to say that there is at least some ^eementeba ; the following stateinents. 

1) A learner must be motivated to le 
in the social situation of the learner. It m^ b^ 
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, an authority (.a method used effectively in armed forces), or is -encouraged by 

the individual's curiosity concerning an unusual occurrence, about which he/ f 

"asks, rt Why? n . In other cases, as. we shall note later, an individuals role 

in an organization ~ teacher* administrator, student ~ often creates situations 

where new knowledge is -necessary in order to cope effectively, or where the *■ ' V- 

individual 1 s own need for achievement is met by gaining new knowledge (McClelland, 

1961) . ISuchsocio^sychological circumstances form the impetus behind thfe * 

motivation to learn (Gagne, 1964) . 

2) The learner must possess certain prior knowledge in order to learn 

a new concept of to discover a new understanding. If a child cannot speak, h£ 

cannot write. If a potential user does n*$t know, aBout 13ISOV he cannot decide 

to seek further information about its potential .usefulness. This prior knowledge 

would relate not only^tothat about-EtfsO itself , but about a given problem, situa— 

* ■ . ■ *••■*> , ■ .* ■ * ■ . 

.tfon, practice or other topic about which information: is needed. How much does 

the user know in advance? If he is almost totally lacking in knowledge about a 

topic; he may not be able to formulate a good statement of the problem for the 

search, analyst. The sear ch negotiation may prove arduous; ancLth^results 

may prove less than satisfactory— at least on the first try. - - 

^ -3) Regardless of whether only a simple fact is learned, or a complex 



concept involving generalizations and inductive leaps, the le&rneir is changed 
in the learning process. Something is learned which was not known before. , 
Expectations concerning the learhitfg' experience are fulfilled entirely, in parS,^ 
or~not at all. Opinions concerning the process; are formed, and may, in turn," 
affect the motivation to^tndertake further learning*. ; - _ * 

Knowledge, in the sense ^used here, can be thought of as a set of facts, 
concepts* ^dtheories related to sbm T e topic or activity^as accepted by those ' 
individuals who are most- centrally involved.^ In generai; : the* extent of an 
individuals knowledge concerning an area is measured against that held bv , 4> 
recognized experts in the area. 'For" example? knowledge concerning prograimme 
development is defined by experts' in the field of programme development. In 



theory, if an Individual could, on demand, relate all\*f the facts', concepts 
theories about programme development to th ese expe rts , he would be said 
have full knowledge about the topic. In practice, it isjiever necessary to 1 
so exhaustive. Instead, only a sample of the facts, concepts and theories 
used, as in any scholastic examination, to assess an individuals knowledg 
In this study, however, specific knowledge *is not assessed. To do so woul 
require testing users on a multitude of different subjects (i*e«,~ oil each of 
topics they submit). Only two items entered on the EISO Service Evaluatic 
"Data- Sheet (Appendix B), are used to measure prior knowledge: number as 
references expected, -and* relevant citations already known (items I>S8 and ■ 
As we shall point out later, it is not really necessary to measure knowledg 
about the various subjects directly in any case. 

„ One particular topic concerning which users must necessarily have 
knowledge is the Educational Information System for Ontario itself. Sinc^ 
awareness of an innovation like EISO is an important stage in the process o 
adopting an innovation, the knowledge about EISO that users possess is an 
important characteristic. Of course, all users necessarily are familiar w: 
EISO, so awareness will be studied as an outcome of the publicity- program: 
which will be treated later. ■* ^ . 

— . r' ' "", " 

Motivation^, Attitudes, and Opinions 

Motivation to learn is a psychological variable of utmost importance 
By -motivation we mean a psychological state characterized by the readiness 
an individual to engage in some activity. In particular," motiyation to learn 
implies that a commitment exists to engage in learning activities. It may b 
oted in other psychological factors, such as personality, or in the social 
economic^ context of a given situation. " Personality itself is a complfe d cr: 
habits, preferences, beliefs and needs "which produce iit a person a dis posit 
ta engage in some activities and not in others. , y 

' Ohe personality trait that has been suggested as a motivating factor : 
seeking information is the need for actaevemimt, a personality force which 



clrives an individual to seek mastery in some sphere of activity or knowledge; - 
An ambitious person is likely to search out information in order to out-distance 
the competition, both by knowing more and being seen to know more, and toy 
> gain mastery of a situation* 8 Two items that tap "this characteristic relate to 
an individual's professional planar the first ascertains the- iiser T s ambition or 
wish to advance to a higher position within his organization (item 8), while the ; 
second asks whether he wishes to; undertake study toward a higher degree in 
the next five y£krs (item 17). ' m Y~ ' ' 

■ Correlated with individuals' personalities are^th^ir attitudes which^are 
expressed as "opinions^ which reveal a predisposition to act in a}spec±Eic way 
toward some object (the so-called "att^ude 1 ? object). A scale adapted from 
Sieber (1972) measures opinions and attitudes tqjyard innovations (items 20 



to 24), while item 48 asks the user about Ms initial Attitude toward EISp, a ^ 
typical educational innovation. * - yr ■ 

^ ; Motivation may also have a sociological impetus;- as when it is derived 
from one's social role within a society, (profession or organization. , Then, it 
is embodied in £h.e expectations for one f j| behaviour held by various segments 
of society^ including the individual himself. Tie r:oles of research director - 
and graduate student? for example, "carry in them the obligation to seek infor-^ 

4 > - ' ' 

mation if the incumbents are to xMfill their social roles. < 

. ■ ■-■ ^ Economic Perspective . r \ 

v . "~ : " .. : ; " > ^' m m ^ : j v "\-\- "Y " ■; ' 

- If EISO were providing only a free^ service, as 7 has traditionally been 
, ■ ■» ■ , * . ■ ' . r 'a - . . 

the; case with libraries, then it would not be necessary to view the user as 

J? * ■ * " ..'*'*■'*•"- 

an economic "creature. However, ElSfO is charging $20 in : the Northeastern 

Region and $30 else where * f thus an eccmomi^persffective'is necessary. 

Economic situations in fact serve to motivate individuals . This occurs. 

whenever it is recognized, by a person that he can achieve some objective or 

fulfill an obligation at less cost in* time or money by following one course of ■ 

action rather than another. Such i^ the case when an administrator chooses to 



••• " ■ - . ■'. . ■-. ■ V- ■' ... . . • 76 

" • . V .: '"/ •' ■■; : '-:*. ; - 

request an automated bibliographic search to satisfy an information need, 

thereby avoiding the alter native^ of hiring a part-time researcher- to fulfill 
the need. . . ? 

In terms of describing the user, one important characteristic is his 
source of funds. Is the user paying himself, °*£ is tlle cost being charged to 
hip organization? This question isK^sw^t " DS11, ; which determines 

who pay^for the. search; it6m"D323 elic# c e same type of information for ^ 




materials ordered as a result of; a search.* lems DS13 and DS£5 refer to the 
source of payment for OlSE users who avail themselves of internal- charge- ^ 

back arrangements. On the whole, -it would be expected that a person who is - 

. • . . . , t - 

paying out of Ais own pocket would be more reluctant, to conduct an EISO search — 
that Is, he would have to be more highly motivated than one whose or^ani^^ipn 
is covering the cogt. ^ ^ ^ . 

'/The User as. Innovator * 2 

" ' -When an educator first trie 3 an ^innovation like EISO, he is engaging 
in the trial adoption of the service. -This trial u^e represents the fourth stage . 
in the adoption process, described earlier. "He evaluates the service (stage , 
five) and, if he finds it to his liking, "may decide to include the service on hi^ 
list of sourceA to be checked when information is needed. The second time he 
tries the system, 'it may be said tnstfhe has adopted the innovation (stage six)." 
To be sure, some usgza; m^^iffeqdite several^trials before making aJEinal 
decision regarding^^j^^value; but, with a fee of $30 it is apparent that 




requesting^! E^OKSfiKPCh is not a minor decision. There are few ex- 
trinsib rewards for imff^rf^djig a search it is not £ vis ible symbol that 
enhances or rdtlects^one T s status. Its real value is in the information pro— 



*vided. If 



f tl^^Jpjformktion |s not satisfactory, then there would be no reason 



\€b choose E-ISp a§ a fiiture source of knowledge 



• r v ^rfat - tame 6xvfe3=ial users of an innovation are of tremendous -importance 
for two^ reasons : ffS^st, they form the major portion of the clientele in the . 

. . . ■ . • * o. . - ■ . ■ ■■ . ■ . . - , 

■ . *V - T ■ -* ■ .1 - • ... * ■ ■»,.. 



first year of operation. Perhaps more ir^ortant^Iy, they assist in the dis- 
semination of information about the system. One user, talks to a colleague, 
and converts that individual from a potential user into atrial user. An ^ infer- 
action effect (Rogers, 1962> occurs, and use snowballs. More and more. ■ 
clients are recruited. But after all potential first-time users have been iservedj 
the repeat user — the adopter — enters the limelight. He is the one who will 
determine, in-thet long rup^ if the^service survives. Loyal customers are the 



mainstay of >any business. . ■- . ■ . m *' 

It is extremely important, -then, to know who the early adopters of an 
innovation are, so that likely ^candidates can be contacted and encouraged to 
*use EISO. To tearn about the diflf^ences. between. trial' and- repeat users, both 
groups will be described in terms of the sociological, psychologies^, and 
ecohoffiib perspectives that have beenjiis cussed in this chapter. I^em 54 in 
the evaluation questionnaire yields the data needed to distinguish between 
novice and veteran users of EJgSO by asking the number of previous EISO 
searches the user has requested. 

Satisfaction with EISO 

A major factor in a first time* user f s decisicto on whether or not to use 
EISO again'is his satisfaction with the EISO.. Has his need for information on a 
.gi§ln topic been rjiet? Was service satisfactory? ; How helpful was the material 
provided?;-: - ' : ■ -. ' .« ' . - 

All of these questions are aimed at learning users 1 ^opinions and might 
be considered psychological in character. At the same time, they relate to 
the individual's roleT tlfe assistance provided by the EISO staff, and the* ade- 
quacy of the technology. Hence, both psychological and sociological perspectives 
are used belowi v "'7 



^ ; Just as we first considered users and their needs in scvciological terms, 
with the latter growing out of their roles in educational organizations, so might 
we consider the success of the*EISO. What role was it expected to play? Did 
it play that role well? h 

\ Item 19 classified the purposes for which users regularly sought informa- 
tion; * DS4 asked f orjthe^purpose_of a particular using: the. samel 

categories. Paralleling these questions is item- 32 which enquired as to the - 
helpfulness of the information provided as a result of the felSO search for eaeh 
of the f olio wing, purposes : keeping abreast, of the field; completing assignments, 
theses, etc; preparing or updating a 'bibliography; curriculum development; 
improving programmes; prefxaring a speech, article, or report; r undertaking 
or completing a research or development project; browsing; recruiting and/or 
evaluating personnel; developing policy; and other* In interpreting the data 
it will, of course, Jbe necessary to consider the individual 1 s purpose in conduct- 
ing a search, It is hardly fair to consider how helpful the information has been 
for evaluating personnel when it was sought for completing an assignment* 
\ It is worthwhile at this point to note a distinction Jjptween the value of 

the search service and the value of the information, acquired as a result of a 

- * ■ . . . " -% - * ' 

search. A potential user, in deciding to pay $30 for a search, clearly has 
estimated that the worth of the service and information to be retrieved exceeds 
3>£0. This estimated value applies to both the value of the time saved by conduct- 
ing an automated search and the expj&c&ed value of the information. In situations 
where an individual occupies a r>ole that requires information be sought, there - 
is no real alternative to EISO except manual searching of indexes, and the 

savings in time alone regardless. of the results — --.will probably be^suf- 

f icient to justify the cost. In most cases* 6i course, the- information retrieved 
will have some value. Two items request the laser to indicate what this value - 
was for both the annotated bibliography itself and the materials located in using' 
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" ^ the bibliography; Users were asked if their satisfaction with the value of these 

-was low, medium or high (items 45 and 46, respectively), * 

Psychological Perspective .\ : : . yr^ 

In psychological terms, the re suits jafa search cycle can be assessed 
in part by the knowledge concerning the topic gained by; the user. In £heory, 
at -least, this question is separate from that of the value of wl*at i» learned. 
t?_QT example, one might search for ways to reduce the heating cost for a ^c^ool ^ 
; and learn that aU effejfij^re solutions had already bee^^&opted, with additifjial 
\ savings of energy jmlikely.N What has been learned ih this case is of no economic 

J vMuei ■ : ..^:v . ^-^ • • - >.._ ; .;*••• 

Knowledge gain, the user* s usual objective in utilizing E ISO, might 
be measured by the use of appropriate pre- and posttests. To do 6o would- 
require testing users on a multitude of subjects (i.e. , on each of the topics 
submitted). This approach is not feasible.* Instead, a- substitute or proxy will 
be used in this study: the individual's own perception of how much knowledge 
he has gained from using EISO to meet information needs. In item 29, the user 
is asked how much he learned about the topic as a result of the search 
nothing or very li^e, some, or a great deal. 

This q^^tt6n is supplemented by two additional items from the seairch 
request form: the number of bibliographic references expected,; and the number, 
of relevant citations already known tQ the user (items DS8 and DS9) „ Both of 
these items suggest the level of knowledge of a user about the topic being 
searched before the search is: conducted.. / ~ "; 

Though an individual may learn great d^al in using material retrieved 
through EISO, he .may feel that there is more information available and that it / 
|S worth seekihg. This desire for additional information is a measure of the ; 
extent tQ which a person' s information need has been fulfilled (item 31) . / 

- additional area of knowledge gain is hot concerned with the user's 

prilsary interest, «but with knowledge concerning EISO. The question of Tiow 
1 ' mudh the user has learned about EISO is. asked in item 30. One would 

! ERIC" - . 



expect th£t a person who has used the system would feel relatively well informed 
about it. : - .[ ' 

Satisfaction, too, is a psychological variable. Whatf'are the users^ 
attitudes about Eis£> now that they ha^le experienced it lirst hand?. Thirteen \. 
items measure their, satisfaction with four Aspects of EISO: B^tiBlished materials,* 
quality of. service, timeliness of service, and quality of the technology employed. 

1 Published materials. _Accuxacy,_^comprehensiveness^ 



directions for submitting search requests, and adequacy of directions for sub- 
mitting, orders for materiafe^were considered of most importance in assessing 
published materials. Items 37, 38, 39 and 40 concerned these aspects, which- 
.were rated in terms of high, medium and low satisfaction;; ; :.Cpmments "were; "■ " 
also invited. Ji : 

.' ' ^ "-. - - - ■ V* 

^ Quality of service . Convenience of arrangements for requesting EISO 

searches (item 33), ..the helpfulness of the search analyst or EIC (item 34), and 
the length of time devoted ^fco the search interview (item 41) were the three 
indexes of service quality./ - 

Timeliness of se rvice . Timeliness of service refers to the time" taken 

' — : — ' — ~~ — ~ - • • / • 

to deliver an EISO bibliography, EISO microfiche or papeiyeopies,, or materials 
ordered from' ERIC Document Reproduction Service in the^United States.. Items 
42, 43, and 44 measured the level of satisfaction with each of these aspects* 

Quality of technology. Quality of technology relate s to several char ■-. 
acteristics of the materials and machines utilized in EISO. Included were tfie 
length of the bibliography, readability of mi cr of i cite, and availability of micro- 
fiche readers. Satisfaction with each of these*was tapped by items 35, 36, 

m - V" ■ " 1 * ■ ' * 

and 47, respectively. 1 • - 

9 > * . • '• " 

Finalljfc three summative or global questions concerning Satisfaction 
were asked. All refer to social action; if they were to be classified according 
to the scheme used here, the could be classified in both the sociological and 

• ' . 4 ' • v ■ ..•"■*".".' 

psychological spheres. . ' . * . . • . 



Would you use EISO again? This question, posed in item 49, is of utmost 
importance. Responses to it provide an- estimate- of the proportion of first time 

users who. are likely to become repeat usersf , / . " " ^ - 

• y ' - \ \ . \ .• • " .■ ■'■ : ;'|;XA , -: v -f:-- v< " . . 

; Would you recommend use of EISO to a pojleague? As noted .earlier, 

colleagial recommendation — the sociological 'interaction effect" — can serve }^ 

to multiply the numbers of potential users. /Hence, this question, asked in 

„ ... . , jp . ■ * . 

item" 50, is also of cbnisiderable ijnportaE^^ both practieally and theprptically, ; c 

- ^> Do you think EISO siearch services should be offered? on a permanent ^ _ 
basis? fA positive response to this- question (item*5i) indicates that users of 
the experimental service accept the idfea of "a fee -for Service information sys\ 
tern which is responsive to their needsN^ negative response suggests a rejee-^ 
^ti'on of the idea. 




; . Summary- 

The framework used in the assessment of EISO is rather complex, 
incorporating as it does sociological, psychological and economic models - 
in a systems framework (a framework which itself is set within a systems 
model for adoption of innovations). Tables I and n help to simplify this over- 
all structure by listing the sociological and psychological variables for the 
user in terms of input, process and output. Identifying item numbers from 
the questionnaire and data sheet are keyed to each factor. Age, for example, 

is a sociological input variable elicited Jby item 52 on the EISO User Evalua- 

.. »' • 

tion Questionnaire. Satisfaction, on the other hand, is a psychological factor 

V .. 

tapped by a number of items, and is on the output side of the system's equation. 

The next chapter concentrates on the characteristics and processes of 
the Educational Information System for Ontario. Of particular importance 
are its ecpnozQic^ traits — cost, price and* viability. > . 
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^BLE-I. Variables forSociologi^al MoSels 



Input 



Output 




ORGANIZATIONAL 

.Kind- of. organization: . 

Purpose of organisation: 




1, 2 



Size of organization?' II, 1 12 . 

Bole of user in organisations 

f.. , t - . 

Institutional t ., _ j 

Aspects re information search: 18 

Purpose for search: 19, DS4, DS7 - 
. Topic/content 

Name of position : 6 ", 9 
Personal 

Training: 55 _ 

Experience in job: 7 

Professional activities: 13, 14, 15, 16 
Trial/repeat use of EISO : 54 
Cost of first search: 31 - 



ORGANIZATIONAL 

Helpfulne ss _af . 
se^chfor 
purpos^T^52 




..ENVIRONMENTAL 

Rural-urban: 5 
Geographical location:. 3, 4 
Language: 10 

SOCIAL STATUS OF USER 

Age: 52 

Sex:V5 - 3 



y 



a*. No sociological variables are classified as proces§ variables ; 
p. Numbers -refer to item numbers on EISO User Evaluation Ques- 
' tionnaire (Appendix G) . Numbers preceded by' a ,f DS ft refer to 
items on the EISO Service E valuation X)ata Sheet (Appendix D)^ 
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TABLE H. .Variables for Psychological Models > ^ 



Input 



s Output ' 



f 



LEARNING 

JCndwledge\(actual) 

Topic: DS6, DS8, DS9 1 ? 
" EISO ■'.>' 

Knowledge, (desired) 

Topic 
. EISO. ? 



Motivation - 

Achievement ne 



ed: ,8,\l?\ . 



LEARNING | " • , . 

^P°y?y^8?L ( act ual).:- ^ 
Topic . ; 

•'V eiso ;'. ,• 

■ ' r " c ■ ' > • 

Knowledge (desired)-> L 



opic: 31 




■ V 



ATTITUDES 

Innovations : 20, 21,^22, 
23, 24 

EISO: 48"- 




ATTITUDES 

EISO: 49, 50, 51 ' ^ 

Satisfaction: 33 to 47 



V 



No psychological ^oxiab|^ process 
variables. {; 

Numbers refer to item numbers on EISO user Evaluation 
Questionnaire (Apptendix C) . Nupibers preceded' with a 
"DS fr refer to items on the EISO Service Evaluation Data 
Sheet (Appendix D) . / " y 
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^Questions, »ef nations and Variables 



r 



1 - 



To the user, -EISO is most likely personified by either the search 
analyst or a local Educational Information Consultant. . m The computer technology 
supporting. the system is relatively invisible to him, ex^pt for the bibliographies 
which are its printed output. Another visible characteristic of EISO is the 
pricp charged for the services and materials provided, prices which are to some 
. extent based on the costs of their production, i.e. , the costs of providing the 
search analyst and'computer system. Ensuring tfiat the public image of EISO 
is accurate — neither too simplistic nor too technical — is the role of publicity 
materials and dissemination activities. 1 

This chapter fbcusses*on the components of EISO described above and 
reports on the type of data collected fro&i both users and the system regarding 
a series of process variables. What kind of intermediary did the user employ? 
How long was the search negotia r tion interview? How much computer connect- 
"* time was used?. How extei^ive were the results? These questiolis are not 
evaluative; they are desefciptive of^vhat actually occurred. Yet\they are of 
fundamental importance, since they measure the^ resources allocated for a 
given search. the amount of time spent by EISO personnel, the amount , of 
computer time, etc. — - and these translate into dollar cost figures. Price 
of services, in turn, are based on cost&i Though this fact often does not 



hold in the case of public services, it does for EISO which offers a service for 
which there is a "free" "alternative. Users have the choice of manually searching 

indexes for information related to their topic. It is for them to judge if the ~ * C 

■ • - : ... . '• 

saving in time EISO provides is of greater value than charges for the service. 
Pricing policy, whose derivation- is explicated in this chapter, i^-^elated to the 
dissemination programme wjiich is tfeiiig conducted to inform educators about 
ElSCJkand Jts^e^yxces. One practice in this dissemination programme was. 
the proyision;pf free .searches to select groups of potential users, with a view. 



•toward stimulating -d&mancL Other modes of dissemination were also tested, . 
-and users were asked where they first heard about EISO in order fco discern the- - 
more effective methods of publicizing, the ^ystem. . : . ^ \ cS^ 

* " r Humkn Resources - ■ 

, ^ Two types tof* Intermediaries are available to he Ip- users adapt* the i£ 
questions to the requirements of the computerized information system used 
by EISO: the search analyst and the Educational Information Consultants-. ' , - 

Educational Information Consultants (EICs) are local educators selected 
from boards, Ministry Offices, faculties 'of education, colleges^/ or OISE Field 
Centres, who ha^e been specially trained to assist users in developing accurate 
descriptions of information needs, and to assist them 'in interpreting information 
retrieved. At present, EICs have been trained only in the Northeastern Region 
of the Province, stretching from Muskoka to James Bay. An evaluation of the 
training programme itself is presented in Chapter IV.' What is of principle 
concern in terms of the effectiveness of EISO and the* contributions of Educa- 



tional Information Consultants to the. systejcn is the extent to ;whi^ch EICs are 
involved in assisting users; Hence, in item 26 each user, w^s asked whether 
or nofe^ ah EIC in a particular agency assisted in developing the search request. 

If ho EIC wias involved in the submission of a search, then the user of 
necessity^went^directly to~the search analyst, a specially trained reference- 
librarian (Appendix K), with the search request. The nature of this contact Was 
recorded by the* search analysttin item DS5. 



Much of the actual work in processing requests was handled by alibrary 
assistant' (Appendix Q). Analysis of this role is warranted, but \jls not included 
within this report. . x - 

: \ . Technological Resources jJ^ ' ' ^ 

-a . - .' • r . r • 

v v ■ V * :'■ , X 

The final component of the information system is the particular tech-^g5 
nology .that is -^eing used ixi EISO^— By technology we_ meajx only those JionAii maPL 
elements of the system, such*as machines, involved in creating the final ^ 
products. The total list of machinea4nvplved in.EISQ is quite extensive 

^ . . - \ / ■ V -s£ " . ^ . ■ /' V^-" '•■ ' 

(Appendix E) , but the list x*f technological items must also includ^ printed 
• " ■ - ' '. ' ■ ' *\ 

materials such as -the EISO manual which was created as a reference for EICs, 
■r " , : - " . • % " ~ /<v. 

and the numerous publications related to the Educational Resources Information 

Center (ERIC) ^ includiijfe: the Thesaurus of ERIC Descriptors (Appendix!^ 

A retrieval system for bibliographic information is -nothing more than 

a mode of gaining access to particular documents or references in a specific 

form. Information searches may be conducted iii t sever^l r ways: manually using 

indexes or by computer using either a batch or interactive system. With man - 

* " - 

ual searches, transcription of references may be required;, as, is true~with 

computerized systems using screens to display results (i r e. , cathode ray tube 
or CRT display units) „ The parti cular. eastern used for the Educational Infor- 
mation System for Ontario is an interactive computer system with an on-line 

- : x 

typewriter -type terminal which gives a printed record of search activities and 

• ■ f * » »■ -• 

the option nf nTf lin^^ftrint^uts The latte^are far less expensive than on-line 

printouts because^ they are run at the site^of the computer; thereby avoiding 
long distance communication costs and allowing f or very rapid printing using 
high speed machine s. . - 

.- Although EISO uses only one computer terminal,* it subscribes to two 
remote search services, those offered by System Development Corporation 
(SBC) and Lockheed. Both systems provide access to 3ERICTAPEIS which in- 
clude all bibliographic information -reported in Resources in Education and the 



Current Index to Journal 3 in Education. Botii-fere on-line, .tbter active services, 

but they do differ in die times at #hicb they are available and in ancillary 

services, provided* SI^ appears to be somewhat faster than Lockheed, both 

^ * - * V "* - • 

in terms of* on-line communication and providing off-line printouts, 'allows 

— * # ■ * • ■ . - '-_ 

the mailing of off-line printouts directly to the client, and has excellent back- , 

up services* LocJcheed appears to be somewhat less expensive than SOC, and 

_aUows_texta^ search 

adding new data bases. In addition to ERIC, ElSO has on request searched 

Social Science Citation Index (SSCI), Psychological Abstracts, and Disserta- 

tiori Abstracts > Two items on the Search Service Evaluation Data Sheet re dord, 

for a given search, the two technological characteristics alluded to ab^ye: .the 

name of the system used (item DS15), and the database searched (item DS16) . 

• It should Jbe noted that costs, differ both by the system used and the ' . 

^iata base searched.; Cost per hohr of connect time for a given service is - 

# not|ed in item DS22 t ^u^d.cost per citation in item DS19. These^ data are directly 

related to the cost of-the. service and, henca, us. economic viability. - 

■ * Another technological^trait bf^EISO, aj/ least from the user* s viewpoint, 

is the availability of microfiche dreaders onjwhich to view microfiche copies of 

document^-frorn Resources in Education (RIE) that.migh^J?e ordered after ^ *■ 

reviewing a given EISO bibliography. Clearly, a user who does not have a 

microfiche reade* will be forced to order paper copies of documents from " 

ERIC Document Reproduction Service (EDRS) in the United States, or do without. 

To ensure-that at least some users hac£microfic^ a small 

number of Educational Information Stations (Appendix G) were placed in various 

locations in lie Northeastern Region* A survey; conducted by the Ontario >-, %. ' 

Secondary £ckool Xeachers' Federation (OSSTF) indicated many secondary V % 

-schools in the province have readers available, as do virtually all university 



and college libraries. To learn j^a user^had access to a microfiche reader, 
and could therefore make use of- the EISO fiche duplicating service,/. three items 
were used. Item 2&, completed by the user, 7 asked if a fiche reader was- 



available and, if so t whether or not it was a .portable type that could be used 

at home. The latter distinction was considered of potential importance .Since 

convenience is a major factor in determining whether or not microfiche copies 

will be ordered andl read. For many reasons, it would be far more convenient 

to use a portable fiche reader in the comfort of onje * s home than to visit a . - ; 

■* - * 

library to use its stationary fiche readers. Items DS30 and DS31 dealt with the 

-question of whether the^i^he reader available_was provided by_EJSO_. T ^_„ _ 



Cost pf EISO Services 



" : ' • V 

The costs of providing an automated search service are necessarily 
very closely linked to the type of organization, the mode of retrieval, the type 
and size of staff, and other local^ conditions. For example, a recent report 
lists over 125 agencies engaged in computerized bibliographic searching of 
the ERIC data base (Embry, 1974), There is little umf ormity in the services ^ 
offered, however. Spma centres provide copies of fiche free, some provide 
previously prepared formation packages, and som^ supply readers. ? 

* v The^osts incurred by such diverse agencies aEnd services. will obviously 
be vastly .different. The wg,ys' K in whi^ch they are measured will be efipally 
diverse* There has been Some attempt to develop models that can be. applied 
to a 'variety- of situations, but most of the cost models to date have referred, to 
the cost of developing the data base4tself and are not relevant -to libraries that 

> %rf^h-to purchase commercial services such as SDC as opposed^ to developing 
' computer sysff^ns to "search, their, own mametic data^apes. v , 

* % Others have attempted to measure tfce economic efficiency of a retrieval 
\ system by , user-oriented and management-orieiited criteria. Lancaster and 
Climenson (1968) feelthat-ihe characteristics that signify the operating ^ 
."efficiency of a system to the- user are its coverage, "usability, recall,, pre- 

* vision, ^response, presentation, and user effort required. These factors 
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in relation to. the various component parts of the whole retrieval system: 
acquisition, indexing language/ searching, arid equipments 



Cooper (1972) has developed a mathematical model to provide a method 
or^mparing costs between different information retrieval systems. The 
y'model divides the total costs rftt — 
\he user and those incurred by the system. For each of these components, 
pW-search^ search, and jx>s€4search.dctiviti^s, costs are analyzed. The 
method allows separa±e3&bst allocations to the user and to the system and 
suggests that there is a T1 trade off between the degree of generality or specif- 
icity required in the search and the cost and benefit of conducting it". 

For- the librarian interested in the costs incurred by subscribing to a 
commercial service, Elm an (1975)' provides a more easily applicable equation. 
He devised the formula. C total = (T x C sum ) + P to represent the total 
cost of completing an on-line literature search. The total^cost is arrived at 
by multiplying the* on-line 'time in minutes, T, times the sum of all costs 
per minute of operation (including computer-connect time, labor, telephone 
hook-up charges, and terminal leasing) and adding the cost, P, of off -line 
printed citations. The average cost of 6.6 computer-aided literature searches 
via Lockheed's Dialog on-line information retrieval system was $47. The 
average manual search cost $250. Time required for the automated search ^ 
averaged 45 minutes; for the manual search 22 hours was required. A recent 
study by Benefeld et al. (1975) showed that a typical appointment for using 
services other than Medline lasted 57 minutes, of which 65%, or 37 minutes, 
was spent on-line. Only 43% of the searches requested off-linfe printouts, and 
those contained an average of 173 citations. The actual average cost tqthe 
user was $45. 96 for computer-connect costs plus unstated administrative 4 
costs, $7. 84 for the time of the search analyst, and $20. 75 for off-line 
printouts. i ■« 

These figures provide preliminary though scant data against which to 
measure the probable costs of providing automated reference service. They 
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also service to highlight an important aspect of the state-of-the-art of charging 
users for library services: little is known about the actual costs of providipg 

^information,^ no common standards are used to assess costs, and rarely are the 

i • • ■ 

means by which costs are, derived made public. Penner (1970) goes even further 

/to. state that librarians either do not know, or do riot want to know the cost s of 

/ -their, systems. He attributes this partly to the fact that charging users for 

/■ ■ ■ ■ »■ ■ ■ . % ; 

.information services has not yet become a common practice among libraries. 
Because costs (no matter how calculated) are incurred in providing these new 

4 Is' > 

services, and because library budgets are not' likely to increase in the near 

future, the user will have to be charged for access to computerized bibliographic 

information (Penner, 1970; 'De'Gennaro, 1973; Jackson, 1975). Brickley and % 

^ Trohpski (1974) have strongly recommended th^t "existing centres must apply \ 

more rigorous programme budgeting and cost analysis techniques in order to 

provide a management data base from which cost -benefit characteristics can 

be determined". It is with the hope of alleviating the scarcity of accurate, 

detailed cost information that the following is presented. 

Recognizing that provision pf computer-based reference services will 

probably not be highly subsidized, data-were collected to try to assess how much 

the user would have to be charged pe^ search in order for such a service to 

break even, or as the economists say, reach equilibrium. To gauge*as accurately 

^ * 
as possible costs involved, the service Jbegan by providing access to only one 

data base, ERIC, via the 1 System Development Corporation in Santa Monica, 

California. Later, other commercial services and databases were added. ^ 

■ . A * 

9 ' ' / - - " " 

An initial estimate of ctosts was made; using -as a model on-line search of ERIC .; 
rising SEfcC's search service via the TYMSHARE communication network. Using 
this arrangement, the local terminal is connected with the computer located 
in California, Costs were also estimated for providing the user with original * 
. j materials cited on the printed bibliography* " S 

To begin with, then, an office with desks for the search analyst and her 

. ■ '" . - - . 

secretary, a typewriter, and two telephone lines as well as - standard office* 



... 9s" 



91 



supplies was built in the section of the Library adjacent to the journals, indexes, 
and ERIC fiche (Appei^dix O). Actual costs were incurred for the budding of 
the room, electrical modifications and equipment directly related to the new 
servlcei a, computer terminal to be.used'by.the search analyst, a miterofiche^v 

.duplicator for reproducihgJERIC fichev and. a jpaicrofiche reader t6_be used 

by the service to check quality of duplicated fiphe. These fepr^sent start-up" 



or one-time costs and are listed in Table m below. 



TABLE IH. Budget £for Capital Costs 



Item 



Price 



Computer Terminal 

Teleterm Printer, Model 1030, 
APL/ASC n, . Computer Devices, 
Inc. \ 

Microfiche Printer /Processor 

Bell and Howel, diazo, 
* " Extra ammonia unit 

* * a. 

"Provincial sales tax 

Office Installation 

Partitions, telephone anc^/ 
electrical outlets, etc. 

' y 

Total 



$3700 



4740 

102 

598 

902 



$10, 042 



Mt should be noted that the new service was able to make full use of the 
host Library* s journals, indexes,^microfiche collections as wfell as the^duplicat- 
ing facilities for making pgper copies of journal articles. Also, users) were 



able to use the fiche readers, and/or reader/printers already available^!! the^/ 



^Library. Thus the costs for providing^a computer-based reference ^service 
described.. hereiri> assume that such a service will be incorporated into an, exist — 
ing, moderii, -well-equipped library. \. > 



Estimated costs per search are reported in Table IV, which incorporates 
a number of important assumptions* First,^ mentioned above, is that the new 
service is created within an existing librjiry setting stnd has full access to 
journals, ^indexes, reader^, *php to copying machines, etc. Second is that staff 
jwdlTJbe iiced on an_armual_basis aifRLdevote_ all)c&jtbgir__timeJtt^ 



This decision is particularly important for the searcl^analyst since it is virtually 
impossible to retain such professional expertise without some guarantee of, 
employment. Third, it is assufiied that a skilled search ^analyst can process a 
maximum o^ approximately 130 searches per miLnth. - Further, the assumption, 
is made that the average search jftill require one-quarter hour on-line at the 
terminal. These estimates were arrived at after a five week trial of the service 
that had been offered previously, and have a wide margin of error. Fifth, since 
Toronto has a node in the TYMSHARE communications system, no long-distance 
charges are included. Last, it is assumed that the new service should attempt 
to be self -supporting, but that the price per search, in order to be competitive, 
must fall within the $30 to $45 per search Vange^ This cost per search, then, ' 
Rovers the negotiation of the search request between the search analyst and the 
user*, the formulation of the search -strategy by the analyst, and the retrieval 
of a 9om^B[tear-generated bibliography which is then ma i led to .user. The 
user submits his request by mail, in person, or by telephone (for which he is 

v , ... ^ 

responsible if long distance charges are incurred) and may order duplicates 
of original documents cited on his bibliography at an extra cost of 10£ per 
page for photocopied journal articles and/or 35<? per fi£he for duplicate ERIC 
documents. " 4 

^ Turning to Table IV, then, we see the costs incurred when varying 
numbers* o# searches are performed per month. I/ven when no searches are 
transacted, -there are stillrcosts of 3>£857 per monthi because the staff, hired. ori 
an annu al basfe, must be paid regardless of whether or not their services are 
used. Similarly, the telephone must be paid for, ringing or not. At a rate of 
'25 searches per month,, the total costs per month are $2408 and the revenue. 



" C • \ TABLE IV. , Ooats. and Revenue for.Search'es per Month' ' ' 



T 



Number -of searches 



Budget item 




.25 



50 



75' 



100 



125 , 150 



Telephone & Telegraph 

SQC/EKIC ($42/hr computer ' 
connect time at 1/4 (jr search) 
TOISHAEE ($ll/hr'Torqnto- 

v- SOC data base) - 

., Mailing : . 1 v' 

^Monthly telephone * 



Oi > 
25.00. 



$,262.50, 
n i '68.75 

r 

, 37] 50 
25.01 




137.50, 

75.00 
25.00' 



$787.50 Jl, 050.0*0 

t 

206.25 \ 275.00 



112'. 50 
25.00 



150 . 59 
25.00 



Supplies & Printing ' 

Terminal paper ($7.'50/roli) 
Printed forms' 

Off-line printing (50 citations 
at $0.1$ each) . r 

Professional v ' 
Librarian n ($14,000) 

'< • >' ' 1 , 

' General Support " 

V\ ■ 

Secretary t rf($8;000) , 



' 7.50 
; 12.50 
'\ 162.50 

,,\Y 



,15.00 
25.00 
325.00 



22, 50 • 30,00. 
37,50 . '50.00 
'487,50' , 650.00 



$ 1,312. 50 $4; 575; 00 

; 

* 1 

343.75 412.50 ■ 
r 187, 50 " 225.00. 

' * 25.00 25.00 

1 -r ; " 

" 37.50 ' 45.00 
■63:50;-. . 75:00 
975.00. 



'1,166,00 . ,1; 16^.00 1,166.00 1,166.00 ,' 1,16ft 00 1,166.00 ' 1,166,'OOj 



666.00 ' 666, 00 



666.00, 666.00 . .666.00 - 666.00 666.00 



Total cost per month 

Total revenue per month 
' at $36/search 



1,857.00 2,408.25' , ,2,'959.$Q , 3,510,75 -4,062.00 
' 0 , 900.00 $00,00 • 2, 700.00 3,600.00; 

1 



fc »Total cost per year . 22,284.00 28,899. 00 35.514.00 ' 42,129.00 48,744.00 

' .Est. cost per' search to .bre'ak . «; 96.33 \ ." 59.19 ', > 4?: 81. • 40.62 
'even (cost" per mo. Ao. of searches) , ; ' \J' - , « . ' 



4,613.25- 5,464>50 

' r 

■4, 500 JO/ 5, 

• •' 
55,359.00- ,61,9700* 

36'. 905 ' ,34i44 



This- column re; 



costs which are-incurred even if no searches are conducted. 
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recer 



ived from filling the search requests at $36 per search is $9000, We can 
see that at this level of requests submitted, each user would have to be charged • 
$96.33 per /search for the service to break even — a fee that clearly does not 
fall within the competitive range of $30 to $45 per search. * 

i _jf _we.t 

this with the additional constraint that one search analyst can provide between 
125 and 150 searchers per month, how many searches would have to be performed 
for the service to be self -supposing? The answer to this question is easily 
visualized in Figure 3. The graph shows that if $36 per search is pharged, * 
the'^bost curve anci the revenue curve meet at approximately 135 searches. 
If any fewer searches are performed, the cost exceeds the revenue. 



FIGURE 3. Cost, Revenue, and Prof it per Month 
( total cost/mo., revenue/mo. at $36/search) 
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* If more than 135 searches per month are performed, a. profit is gained. 
However, it should be remembered that the capacity of one search analyst 
cannot be stretched without 4 limit.' Beyond a level of 130 to 15D searches 
per month, another search analyst would have^to be added to the staff, thereby 

_ raising thp_eosts to_ a new le vel: . Another solution is to raige' the_price_ per 

search above $36, to say $40 per search to allow for a greater area within 

p. ^ - 

which profits can be made or, if we assume, that cost recovery and not profits 

' . \ * • 

are the objective, so that the analyst would be able to perform fewer searches. 
Howfever, before setting this higher price, other factors such as the price of 
competitors, and the elasticity of demand would have to be weighed carefully. 
Unfortunately, the Ontario market for^uch a service is virtually unknown. 

In addition to the costs already- mentioned are those that are more in- 
direct and- difficult to assess accurately, but, are, nonetheless, just as real. 
They,, too, must be considered before an organization, in this case *a library, 
institutes a major new services These are what, economists call "opportunity 
costs". Whenever we are faced with choosing between .alternatives, we -must 
give up one thing to get another. What We give up is th^o^ort unity cost of 
what We get. "The opportunity cost of a good is the alter rjative that must be 

.given iip ? to obtain that good'f (Lumsden, Attiyeh & Bach, 1974). " If, for 

y '*\ •■ \. - 

example, the cpst of publishing bibliographies and providing a computer- 

based reference service were similar or the same, * and the library could 
^support only one of thesejservices/ but not both,^md if it chose to support 
automated reference ^ then the inability to publish bibliographies would be the7\ 
-opportuhity^cost of the chosen service , Sw - 

Social costs must also be considered. If, for example, ^several hundred 
educators a year avail themselves of the vast quantities of educational informa- 
tion available through computerized techniques, return to their classrooms with 

• v ^ - s 

new curricula and teaching approaches which then benefit their students, the 

/ * .. 

benefits sof the new service may dq, far-reaching. If,>ln addition,* the new 

service adds to thfe reputation of the sponsoring organization as a leader in 
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educational development, provides new jobs, eliminates duplication of research 
efforts, and contributes to a better understanding of knowledge dissemination 
and utilization in education, these tJenefits may serve to outweigh other cost 
considerations. • * ' * w 

- — It becomes-clear at ^hisj^iiit that even, an .accurate calculation of the 

direct monetary costs incurred in implementing any new service cannot be 
used as the sole determining factor in decision making. Since the benefits^ 
and costs of the service* under consideration go beyond the single individual 
using the service, the service fnight be considered analogous to a public good 
In that, case, ^the\us r e of investment criteria are not enough. Value judgements 
must. be made: personal, professional, organizational, and user preferences 
must be considered. 1 1 will be easier to make rational choices if the decision 
is made within a consistent organizational philosophy. If the goal is to provide 
the best available educational information to as many educators as possible 
within the lowest possible price, adopting the new service may be justified. 

Against this broader view remains the necessity of accurate measure- 
ment of actual costs incurred in" providing services. Cost is defined as 'the 
total cost in dollars^of producing a given service, iteni, or both. For costing 

an EISO search, Elman T s (1975) formula Total. cost = Minutes for search x ». 

Cost per minute, of service + Cost of all printed citations — serves as a guide. 
The search cycle, including question negotiation, reference retrieval and 
document retrieval, will be costed using a variation of this formula. 

Question negotiation is comprised of a sggj^es of actions and responses 

engaged in by the client and search analyst during which^they both acquire a 

• ' A 
thorough understanding of the sear6h topic which the search analyst translates ^ " 

. into a format usable for a computer search of an appropriate data base.- The 

search follows, with the strategy being ^modjif ied if necessary in order to ensure 

relevant references are retrieved. While -the entire search cycle has innumer- 

- able characteristics, only two are considered in fc&is report:* length "of time of 

v 

the negotiation phase, and length. of time of the search phase during which- the 



-97 



f 



computer terminal is connected on-line to SDC or Lockheed. Both periods are 
recorded in minutes by the search analyst on the. Data Sheet in iteins DS14 and 
DS17, respectively, ^'and axe of particular importance because of their direct 
relationship to the actual )*>st of the service. -During the- total elapsed time, 

the_search„analystls salary^ must be_ counted; during the period the^ terminal 

is connected, charges for the search. service must be added as well, Separat- 
^ingthe two time periods departs, some wh&t from Elman T s approach which asisumes 
* that each minute of negotiation costs the same as every other. We view the 
negotiation process instead as a- two stage process: negotiation alone first, 
followed by negotiation plus computer searching. An estimate of the total post 
of ia search can be made' using the following Set of formulas. 

If t indicates the length of time in minutes of the first phase of the 
negotiation interview and t^ l&e length of the second phase, their cos^6 ihcurred 
for the search (excluding administrative overhead and cost of citations) are . 
given by - - ■ _ 

Search costs = c 1 < t 1 +t 2 ) + c ^2 " ^tSl + ^V*" 0 ^^ 

where c .= salary per minute of the search analyst, and c = cost pter minute 

"X 2 , 

of the search system, » 



2> 



The difference between this model and Elman T s is important. This- 



approach can accoimt for the -fact that c + c 0 is much greater than c alone. 
That is, time spent in negotiation during which the computerized search system 
is operating is far more expensive than time spent with the search analyst 
alone. For example, a search analyst might be paid $7. 80 per hour ($0. 13 

i 

per minute) and the connect time, charges for an interactive system- might equal 

* • 

$120 per hour ($2.00 per minute). That is, c = $0.13 >and c + c_ =$2.13 

1 X & 

If "price is substituted for^costin the above equation, and t^+^g set equal to a > 
constant (the total elapsed time for negotiating a search request and retrieving 
references),, then two linear equations are formed whose solution for t^ and t^ 
is quite^traightforward, and yields the break -even point at which the price 
covers costs. 
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For example, if $30 is charged for a search and the search is conducted 
in 20 minuses, the equations are 

30 = 0.13t + 2.13 1 0 x 

20 = A t, + t rt \ 

Z 1 2 ^ ' 



Solving these. simultaneous equations yields t^ = 6 . 3 >and t^ = 13. 7. Therefore, . 
if the analyst were on-line for more than 13. 7 minutes,* direc; osts for the 
search would exceed $30. For- example, ifjt = 5 and t = 15, then the cost 

JL ^ 

\*jould total $32. 60. On the other hand, if t = 10 and t = 10, the total cost . 

would be only $22.60. Clearly,* it is more economical to negotiate a question 

with care before going on-line; also, a good typist on the terminal would prove 

more economical by r ^r than a poor one. r . 

^la-addition * negotiation cja&£s, charges are made for each citation 

printed off-line; following' El man, these costs may be represented by P with 

• P = np .where p is the cost per citation (item DS19) ancj n equal to the number, of 

citations (item DS18). Added to the cost of negotiation, we~have 

* Total cost = c^ t- 4* (c + cU + P a ~ 

1 1 1 1 £ & 

1'' ■ s ' - 

If: materials are ordered by the user, the^r numbers are noted as 

* - . ) 3 * * 

follows: number of microfiche copies ordered .rom EISO (DS26>; number 
of copies of journal articles (DS27); the number of copies of ERlC documents^^x ' 
ordered from EDRS^(DS28) ; and the number of microfiche ordered from 
EDRS (DS29). ^ ' " * ■ 

Other time variables besides those related to search negotiation are 

• also recorded. They are related more to the efficiency and turn around time 
rather than the character and cost of the service.. Relevant dates are included 
fpr receipt of search request! (DS1X, interview with user (DS2), search executed 
(DS3), and bibliography received by the usei 5 (DS21). Each of these step^ may 
not occur in each search cycle, or course. For example, no interview majrb^ ' 

necessary if a search request is-well stated-by-an Educational Information _ 

Consultant. Also, the EISO staff may not always be aware of the date a 



i 



99 



bibliography is received by the client since many are ^forwarded directly. 
Nevertheless, the" intervals between these occurrences 'would provide insight 
int^ the length of time ngeded^io process search requests, so that delay^Twould 
be spotted. * % X, 



^^cicing Policy * - ^ 

First year, price s-foi* EISO search services and materials were deter- 
mined on the basis of the preliminary analyses reported in this chapter. They 
suggested that $30 would be a lower limit to*the range of prices that might 
provide sufficient revenue to support an information system on a Weak -even 
^-basis^ With the low volume of search requests expected during the first year of 
operation, : it is apparent that $30 is a highly subsidized price at the -present time. 
-\ While $30 was the standard price, /in certain cases no fee was charged 
t f6r sxx E3SO search (e.g. , introductory searches for school boards in the 
Northeastern;Region) and in others a-fee of $15 was levied (e.g. , 1975 OISE 

* Summer Session graduate students) . A fee o£ $20- was set for users from the „ 
Northeastern Region, taking effect once free searches were" exhausted. These 
lower prices were offered in the hope that a M seed TT of .satisfied customers might 
be created that-would stimulate or catalyse demand (Lawton & Lawtcjn, 1975). 

Fees £or microfiche copies, ✓ set at. ^5?" e^ch, and for papeif^copie^ 
of journal articles, set at 10£ each, were meant only to cover costs of supplies. 

* The first is below the price charged for an equivalent service from the ERIC . 
Document Reproduction Service, but exceeds their charges for large offers 
since EDRS uses a pricing fornjula that decreases price as more fiche are 

Ordered (Appendix N(x).). The 10<? . fee for paper copies is equal to thai. 

changed by the OISE Library on its self -service machines, but above that charged, 
■ ^ ■* * 

for its internal duplication service. . * « 

* * <• ' 

Since EISO fees for microfiche and paper copies were set, there was 
- \ . * ' * \g 

ncTneed^to record them on data sheets. Price for a given search, in contrast, 



was-recorded (item DS10) , as was the price of the user's first search^ (DS 32). 
The latter variable was, of course, collected only for repeat users. < 



V " ' ' - ' ^ Publicity 

iarxshq 



Free or discounted EISO ^arx3h^s have been mentioned ate .one 'method 



q£ stimulating demand, for the service/:. This effort was limited,* however, comr 



pared to that expended experimenting witl^pther inodes of -di s sem tn atio n, such 

• _ " ■* * ■ i> ' ' ■ " ' % " '" : ■ •* • ■ 

* as brochures, articles, and- professional" development days* ^< 

■Direct mailing of brochures or flyers describing jEISOu(Appendix H) 

wept to all school boards, faculties, of education, . "Ministry ©^Education offices, - 

and educational organizations in Ontario. '.Sufficient copies; were provided for 

boards to distribute two flyers to each, school* Within Th^ Ontario Institute for 

Studies in Education, copies were sent to all. 1 50 faculty and 2000 students. - - 

*' * - * • . 

As well, OfiE Field Centred and the <DISE Library were provided multiple 

copies for distribution. The flyer, it will be noted, .is suitable for posting, 
and incorporates a search request form on the reverse side. ^ 

Articles, based on the content of the flyer, appeared in major Ontario * 
educational journals: The Forurcu The Educational Courier^ . Orbit, and Ontario 
Education. A similar article has been submitted to Dimensions (Ontario 
Ministry of Education) and is. planned for OCLEA (Ontario Council for Leader- 
ship in Educational Administration) . - The articles in The Forum and the Courier 
both incorporated search request forms, run as full page advertisements 
(Appendix I). 

Professional development days (Appendix J) have been conducted at 
"numerous locations in the Northeastern Region and several within Metro, includ- 

- ... -7 L ,Vr- 

diigpISE. Eachr session usually lasts two "hours, and includes anron-line demon- 
stration of -a search-on a topic suggested lSy those present. 8 Inc. almost all cases, 
aigLeast one of' the principal investigators for the EISO project has participated. 

Classroom instruction about EISO has taken place at OE3E on several * 
o c casions /usu all y^pn invitation of the instructor. Sessions are similar to those" 
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offered on professional development days, though may be related^ as apprb- 
priate, to the cc&tent of the course. The on-line demonstration; hQwever; is 
given in the EISO Office in the OISE Library, rather Ahan in. the classroom. In 
several cases, classrpom instruction was combined' With the offer of free 

'searches. ^ J" - ■ 

Colleagues, the literature indi6ates, .are a major sourcejof new? ideas 
for all types of prof essiQnals, including educators (Stern et -al. , 1976) . The 
* use of colleagial networks is^Hot totally beyond the^ontrol of? the professional 
disseminator* Attempts have? been made' to capitalize on these networks by aiming 
.prof essionaL development days at individuals who, in the investigators'' views, 
were likely to be influential. However, no systematic data were coHected-to 
assess the accuracy of these choices ^ _ • 

Educational Information Consultants in. the Northeastern Region were 
considered possible disseminators of information concerning EISO .'\ Hot only 
had they been trained'in<the use of EISO, they had been presented with, a role 
.description (Appendix K) that included the responsibility for disse mina ting 
information about EISO. However, no specific training in this regard was 
given (Chapter IV) . * 

Library tours are regular offerings of the reference staff of the OISE 
Library, who also provide special seminars on the use of various 
retrieval techniques. Productive efforts were made to integrate familiariza- 
tion with EISQ into the schedule of these services. ^ 
* Other sources of information concerning EISO were expected, so an / 



open-ended question allowing the user to respond was included in item 25, Whichl^r 
requested the source of their first information about EISO. \ 



' V. Summary ^ m . 

To recapitulate, one may ask/ not only who used the information system 
provided by EISO, and how satisfied they were with -the service, but also, 




"What is EISO?^ T ^^o are the professionals that form its staff? What is its , 
technology?' How much does the 'service cost to use ai^cL to run? How effective 
are^different modes of publicity. . 



Table V s ummar izes me variables used in the ecbnoniic input -process- 
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'output model of the information system which has been, used to, structure the 

questions asked. Most questions -are related to the technology and service 

aspects of EISO. Onlyfafew items measure costs- additional study ^of costs 

beyond that suggested in this chapter will be required at a later date. . 

We now turn to a preliminary analysis^of the data reported t>y users of 

EISO who became it^clients between July 1, 1975, -when a trial run during the~ 

* . ' ; - 3. r . ... . ' 

OISE Graduate Summer Session commenced*, andean nary, 15, 1976, when data 

collection for this initial report ceased. The frame work, presented in this and 

the preceding chapter will be used to characterize the lise^rs in sociological* 

psychological and economic terms. r The .search process will be described in 

terms of its costs and time requirements. At a later date, 3S^lationships among 

background, process, and output variables will be a na lyzed. Included at that 

time will be a comparison of novice and veteran users. 



TABLE -V. Variables for Economic Models 



I nput 



Process 



O utp ut 



TECt^PQLOGY 

R e tr iejVal^ sy s te ht: , 

'DS15, DSI6 
Fiche reader avail- 

* ability* 28, JDS30 a 
EIC: 26, DS5, DS20 
Fiche/paper copies 
Mjpde of dissemination 
re EI SO:" 25, DS31 



PRICB^DEMAND 

Price: DS10, DS11, 
DS12, DS13, E©23, 
DS24, J3S32 

Level of usage • 

COST— EFFE CTTVENESS 

Cost: DS19, DS22, 

DS18, DS17 
Level of usage 



\ 



TECHNOLOGY 

Length of inter— 
* ^view: DS14 
Length of search I 
DS17 

Time to deliver bib-. . 

lipgraphy: I>S21 
Time to ^deliver > 

materials 
Time to process- search 

request: DS1, DS2,~DS3 



1 1 



TECHNOLOGY 

No. of babEogr^hic 

citations : DS18 
No. of articles 

ordered: 'DS27 
No. of documents * 
r ordered: DS26 
No. EDRS paper * 

copies': DS^B^,"" 
No. EDRS^ficjhe 

copiers : DS 29 

.PEICB-DEMAND 

v 

/ - t 

Level of usage 



COST-EFFEC1TVENESS 

See psychological 
and sociological 
outputs 



COST-BENEFIT 

•Cost: DS19, DS22, 
DS18, DS17 



COST-BENEFIT 

See psychological 
and sociological 
outputs 



a. Numbers refer to items on the EISO User Evaluation Questionnaire 

(Appendix C) . Numbers preceded by a T, DS tT refer to items on the EISO 
Service Evaluation Data Sheet (Appendix D). 
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-cfAPTEK X 
Description of Preliminary: Findings 



A description of the types of individuals who have used EISO is the first 
topic of tUis chapter, and a preliminary answer is given to the question of "their 
identity. j-This is followed by a tentative outline. of some of the actual "costs of 
<- conducting EISO searches. * x / ■ . - 



User Survey 




A Every user of the EISO search service was given or sent an EISO User 
Evaluation Questionnaire to complete. This chapter describes the responses 
made by those individuals who received questionnaires before January 15, 1976, 
and returned them by the end of that month. In all, 300 questionnaires were 
distributed; of -those, 122 (40. 1% had been. returned fty the cut-off jdate of 
January 30, which had been established early enough to allow sufficient time to 
prepare the data and to complete a preliminary analysis As some of the users 
requested more than one search during the evaluation period, the actual number 
of distirtct individuals who completed the questionnaire, only 102, was. somewhat 
less than the number of questionnaires collected. Five users indicated that 
they had used the search service more than once, but returned only one ques- 
tionnaire each. 

In the analysis that follows, the data are treated as if each search were 
conducted by a distinct . user; that is, the data aire treated as if there were 122 
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users. In this way, proper weight is given to the rol^ repeat users play in the 

operation of EISO, * * *■ • 

• Rite of return for ^uestiottftaires was somewhat dip appointing! Forty-' 

Jive petcent of the questionnaires mailed to EISO clients who used the service 

during the six-week trial period, July 3 to August 13, 1975, were returned; 

the comparative fjLgure for "regular", clients (those requesting a search after 

August 13) is 38%* Since mailing of ail evaluation questionnaires commenced*^ 

in late September, overall rate of return5may have been depressed by the pro- 

longed postal strike last autumn. As Well, the length of the ^questionnaire, 

which had, in f acf, been planned only ais a draft to be replaced in the winter by - 

' / • • . . s . 

a new version, may have discouraged a better response. ^The revised version * 

. . • * ' - - . \ . X, . 

of the questionnaire, now being prepared for spring, should, alleviate this* 
problem. <V — ^ v . . . ^ : - 

The User • rj- " ' , \ 

Sociological Perspectives \ 

Or gani zation . TabiefVI provides information about the .first type of 
social characteristic of the^iser, namely the organization or institution,, with ^ 
which the individual is primarily-associated. It shows that OISE faculty and 
students comprised the greatest number of EBO users coming from a single 
institution: 4r5, or 37%. Here the most heavily represented departments were 

Applied psychology, Curriculum and Field Development, with eight useris ;• * 

>' * ■ - * 

each, or a- combined total c^^3^ of all OISE users. Special Education fol- 
lowed with six risers or 13%P the" OISE 'Library had five users; Educational 



Administration, four, Adult Education, three* £nd History and Philosophy, one> 

Users from Ontario public (37) and separate (16) boards — including 
elementary and secondary • schools, as well as central board offices — com- 
prised 30% and 13%* respectively, for? a total of 43%; x The distribution for 
the rem aining org aniz ations is as follows: Ministry of. Education, seven (5.^7%) ; 
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.v. 



TABLE VI. Organizations Users Primarily Associated With 

. . • ■ . x : . * - ■ • - . ■ 


f - - ' ■ ■ 


Number 


Percent 


Publii^ board ^ , / • 


. 37 


30.3 


Separate board C -.. - * . 


16 


13.1 


CAAT 




1.6 


<* 

Faculty of Education «► . 


' • •• . • 5 




OISE " V 


45 


, 36.9 


University p " r " ■ ■ 5 


' ■ 3 C 


2.5 


-Ministry /of Educations 


V 

7 - 


/ 5.7 


Professional organizations 


1 .. . 


0.B 


Government r 






Business - 


• * - 2 


1.6 


Other 


2 


li6 


Total 


122 


100.0 



Faculty of Education or Teachers 1 College, five; University, three; eaqh of *■ 
CAAT, government, business or industry and other, two. 

For the 51 users- associated with school boards, v either in an adminis- 
trative or teaching capacity, the average board enrolment figure (mean score) 
was 30, SSSjV.with a minimum of 3081 and a maximum of 99, 894. T3*e average 
enrolment of schools, based on 23 valid observations, was 624, the minimum 
being 114 r and the maximum 1620. 

Bale. ^Fhe second type of Asocial variables under consideration are the 
institutional and personal dimensions of the users' organizational roles. With 
regard to the institutional aspect, a maximum of three major professional 
roles was/ascertained from each respondent, as is shown in Table VIE. The 
^primary function of the highest number of users (33,- or 27% was administration 



* TABLE VH. Users' Major Professional Boles 



.A 



Role 



Number 



Percent ; 
I 



ADMINISTRATION OR SUPERVISION 
No other role ^ 

Second rolec . * * ■ w / * ■ 

Caching *. ? 
* piipil-Personpiel Service ^ 

M.Ed, Student 

Ed* Student 1 ' . 

M.A." Student 

Total 



TEACHING 
No other role 



Second role: Administration 
Third role : M. Ed. Student ■ 

, fc 
Second role: Research 

Third role r Administration 

• " . - M.A. Student 

Seoc^d £ole : Field De velopment?-* 

Second role : M. Ed. Student 
M.A. Student" 1 
Other 

Total J 

' I ■.'!!.. 

PUPIL PERSONNEL SERVICES' 
Second role: M. Ed. Student 

Total 

RESEARCH 
No other role 

Second role: Administration 
Third role : Teaching 

'Library Service 

Second role : Teaching 

Library service 



r 

c 

V 



24 

" 1 
1 
5 
1 
1 

33 



1 J 

W 



2 

i 
l 



17 



2 
1 

1 



19.7 

0.8 
0.i8 
4.1 
0^8 
0.8 



27^0, 



3.3 J 
} 



3^6 
0.8 



2.5 
0.8 
0.8 

0.8 

1.6 
0.8 
'0.8 

13.8 




0.8 



5. 7 



2.4 



'4.1, 




Table VII (continued) 



Role 



Number* 



■Percent 



Second role: - Other 

Third role : Teaching 

■ V ■■ • ' " * Total 
pFlETJy DEVELOPMENT 

'-'No. other role- 

> . »■ 

Second role: ReseartaE 
Third role: Teaching 



12 



Total 



JV^NISTRY JRlEdONAL OFFICE 

No other role - . ' 

Second role: FiehLDevelopment 
TMrd roleV Te^^ng 

\*» Total 

LIBRARY SERVICE 
No other role : * ■ 
Second role : Adrninistration 

Total 

PRIVATE CONSULTANT 
Second role: Research ' 

.Total _ 

UNDERGRADUATE STUDENT 

M.Ed. STUDENT . _ 
Second role: Teaching 

Total 

Ed.D. STUDENT 

No other role 

Second role: Teaching 

Third role : Adniinistration 

X Total 



or 



0 

ERIC 



5 

3 X 



6 
1 



X 

9. . 
1 
10 



0.8 
9.7 



4.1> 

2.5 
0.8 

7.4' /. 



4.9 

0.8 

5.. 7, 

7.4 

; 0.8 

8.2 

"0.8 ■ 
-0.8 

0. 

2.5 
2.5 

3.3 

0.8 
4.1 



v. 



1 1 *? 



Table^ VH (continued) ; 



Role 



Number 



Percent "Sx^. 



Total 



M.A.- STUDENT 
No other role 

' • * V. . • • 
Ph.D. student- 
no other role 

Second role: Teaching 
Third role: dther 

Second role: Researcjt 

Third role : Private Consultant 



JS 



econd role: Other 



-Total " /■ >^ 
Total Students 



5 



10 



i 
l 

14, 

27 . 



4.1 
,4.1 , 



"8.2 

0.8 ■; 

0.8 

0.8 
0.8 
11.4 

22.1 



} 1.6 
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or supervision; 24 of these listecl no other roles and thus -represented the 

largest single group. Other categories (excluding those comprising less than 

5%) given by jusers as their most important professional role included teaching; 

17(14%); Ph.D. student, 14 (11%); research, 12 (9.8%); library services, 

10 (8.2%); Field Development, 9 (7. and Ministry of Education Regional 

Offices, 7 (5. 7<%) . The "Other" category includes one employee at the Regional 

Office of the Ministry of Correctional Services — Juvenile Division (Training 

Schools); one business consultant to Bell Canada; one school counsellor; - 

one psychologist; and onc^ community organizer". - •. 

In the first three major professional functions for us^rs, namely ad- 

ipinistr ation, teaching and research, the following secondary (II) and tertiary (IQ) 

roles (which no^doufet also affect to a large extent an individual's decision to 

try the service) occiir^most frequently: . 

AHmiiiistration : . (IE) Five M.Ed, students, one Ed.D. student , 
and one M.A. student (5. 7%). 

Teaching : (II) Five in research (4.1%) with administration and 
* ^ M.A. student listed as (IE) in one case each; (II) three in 

administration (2. 4%) , ope user indicating M.Ed, student as 
(IH); (H)* three graduate students, two M.Ed., and one M.A. , 
accounting for 2.4%. 



Research : (D) Three in administra&on^2.4%), two of whom 
stated that their tMrd most important function was teaching, 
and one giving library, services as (HI) . -Furthermore, two 
researchers indicated teaching, one as a secondary role, and . 
the other as a tertiary role. 

Regarding the professional role of school board personnel, Table VUU 
shows the breakdown. Sixteen users (31%) were employed at the elementary 
level only; four (7. 7%) in the secondary level only; and four at both elementary 
and secondary levels. „ flr ". 

The highest proportion of school board users (20, or 39%) were from 
central board offices, while eight (15%) occupied "other" levels (e.g. , board 
librarian). < 
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TABLE Vm. School Board Personnel L^yel of Primary Position 



'Level : s h 


y 

Number 


. Percent 


'Elementary 


16 


r 

1 - * 30.8 


Secondary 


4 


- 7.7 


Elementary and secondary' 


. 4 


7.7 


Central board offices 


20 


' - 38.5 


\ 

Other 


.8 


15.4^ 


- Total 


52 


100.0 



-The frequency with which EISO : users sought information for their varied 
professional activities; appears in Table IX. In order to f acilitate comparison 
in the descriptive analysis, it is convenient to combine the responses "never" 
and "sometimes" to form the "low" categories, and the responses "often" and 
"very often" to constitute the "high" category. \ 

The purposes for which users sought information most frequently were, 
keeping abreast of the field (78% in the V high" frequency category), programme 
improvement (64%) , and curriculum development (53%). In descending order, 
other purposes included research and development projects (48%) ; preparation 



of speeches, reports, and articles (47%); assignments, term papers and 
theses (41%); browsing (37%J ; preparing or updajting bibliographies (21%); ... 
policy development (18 and personnel recruitment or evaluation (10%. 
Clearly, this is an overall picture for users; those in particular roles might 
well search for information with far greater or lesser frequency than does the 

"average" user. . " . _ * V**^ 

In terms of the approximate time per week spent by l£e individual user 
in obtaining information from various sources, and the value of the information 
gained, professional journal and books, followed by colleagues, emerged as the 
two most frequently consulted and valuable sources (Table X). - 
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TABLE IX. Frequency Information Sought for Professional Purposes 



/ . , " * * ■ „ No. 

Percent 



Purpose 


Never 


Sometimes 


Often 


' Very often 


vana 
cases 


* > 
To kee£: abreast 'of the field 


1. 


<-* 

7% 


20.8% 


50. 


8% 


26.7% 


1.20 


V 

Assignments, term papers, 


28. 


4 


ou • ^ 


15. 


5 


25 9 . 


116 

~L. V 


..and theses ' - 










- 


\S ■ r 




« 

— — — ^^v* A^{fl^ 

Jrreparing or upaacing 


26. 


8 V 


Ul • Of- 


11. 


6 


9 8 


112 


bibliographies 














> 


"■ > ^ fc * 
^Curriculum development 

J - - 

Programme improvement 


16. 


i 


31. 3 


33. 


0 


19,6, " 


112 


14. 


8 




42. 


6 


**- 


lid 


Preparation of speeches, 


1 o 


1 


41.4 




o 


12.9 


r 

116 


reports, articles 
















Research and development 


17. 


1 


34.5 


28. 


3 


19.5 


113 


projects 
















Browsing - 


4. 


2 


58.5 


28. 


8 


8. 5 


118 


Personnel recruitment or 


49. 


5^ 


40.4 


8. 


3 


.1-8 


109 


evaluation 
















Policy development 


*32. 


4 


49.5 


9. 


0 


9.0 


111 


Other v • . 


33. 


3 




'33. 


3 


33.3 


9 



/ 



- r 



-Rir 
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TABLE X. Time Spent by Users in Obtaining Information and Value of the Information Gaioed 

Value" 



Source 



Approximate time spent '{Hours per, week-) 

Nb.\afid 



N). valid 



Colleagues 

I¥ofessional*journals ( books 1.8 9.6 ' 14.9 1 6J 7 28.9 28.1 114 ; 2.7 36.6 60. 7 



.44.6 32.7 , 8:9 



Outside consultants 
'■ Inside consultants ; 

Office files, reports" 
"Supervisors 

Professional organizations 41.0 41.0 
Libraries 
Conferences . 



9.9 
9.8 



26.5 30.4 20.6 
T8 7 2i:o 2979 
30.2 26.4 23.6 11.3 



4.0 
3.9 

"9.3 -7.5- 

7.5 0,9 



101 31.3 50.7 17.9 



102 19.0 45.6 35.4 



■ Professional development 61,2 18.4 J10. 7 
'/days 



0 1/2 h ' t * 3-6 . 7+ cases Low Medium High cases . 



I 11.5* 15.9% 30.1% 29.2% 13.3% 113 ' .,8.8% 31.9% 59.3% 113 .' 

112 
67 
79 . 
-91- 
87 
73 
103 
83 
60 



8.0 

34.0 40.6 



10.5 5.7 
12,5 ' 25.0 21.4 
20.8 ' 



2.8 
3.9 



1.9 
17.0 
1.9 
3.9 



lfi.l 



"107 
106 
105 
112 
106 



30.8 -^38.5 -30.8 

27.6 33.3 39.1 

43.8 26.-2 7.4 

11.7 319 .50.5 

34.9 50.6 14.5 



1,9 '103 ' 48.3 38.3 13.3 



: Academic, professional 50.0 3.8 
courses • 

. Curriculum guides, texts 26.2 31.8 18.7 10.3 



6,6 5.7 17.9 * 16.0 106 ' 15,7. 37.1 47.1 70 



ERIC, materials 

Education abstracts', 
< indexes • 

Other 



23.1 35.6 16.3 13.5 
35.9 25.2 23.3 V 1,9 



9.3 
9.6 
10.7 



3.7 107 20.5 61.4 18.1 '83 
1,9 104 13.8" 39.1 47.1 87 
2.9 " 103 16.5 41.8 '., 41.8 "*79 



37.5 



12.5 12.5 ' 25.0 12,5 16 - $0,0 70.0 10 



j| -Eighty -four out of 114 users indicated that they spent two\hours or more 
in obtaining information from books and professional journals; 32, or 28% 
spent piore than seven hours, 33 (29%) three to six hoiirs, and 19 (17%) two 
hours. One hundred and nine (97%) users considered the information from this 
source of medium or high value. Eighty -two of 113 respondents said that they 
spent from two or, more than jseven. hours per week in exchanging information 
with colleagues. The information thus gained was felt to be of medium or high 
value by 103 (91%)^of the users. Professional Developtnent Days/ prof essional 
- or ganiz ations , outside consultant's , - - conference s and education al ab s tract s or * — — 
indexes, among others, appeared as sources from which information was sought 
with least frequency and by the smallest number -of users. 

To use an^ example, according to 87 (86%) of 101 respondents, one hour 
or less. (45, or 45% indicated zer^t hours) was spent with outside consultants; , 
consequently 31% of 67 clients felt the information obtained to be-of low value.* 
The comparative figure for professional organizations is 97 of 105, or 93%, 
with 43 users checking zero hours; here the value accorded to tie information 
acquired was low in 32 out of 73 cases N (44%). One must bear in mind, however, 
that these sources, including academic ^sjources, were in many instances seen 
by the user as non-applicafc£t^in, his or her particular position^ For example, 
63 (6^J&) of 103 users stated that Professional Development Days did not apply 
t#"them, and 50% of 106 respondents indicated that they were not involved in 
academic course work; zero hours was checked in each case. 

It is interesting ^ note that in several cases where sources such as . ... 

• " ..." ■ * : 3 

outside, consultants, supervisors, ERIC materials, and educational abstracts 

were consulted for two hours or more pei; week by only a small number of 

respondents, a disproportionately high value of the information provided was 

indicated. Sixty -nine percent of the 67 respondents using outside consultants, 

fojind them of medium or high value though only 14 of 101 (14%) consulted them 

for more than two hours'per week. For ERIC," 86% of the 87 respbndents found 

the materials of high vaiue, even though only 16 erf" 103 (16%) used them far' more 
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than two hours per week. Similar comments apply for information sought 
.from supervisors and educational abstracts. This finding can be interpreted 
in a positivi light: even though the majority of users spent one hour or less 
seeking information from these sources, they must have found the infor m ation 
they located extremely useful and satisfactory, a fact which is of some importance, 

particularly since ERIC materials are retrieved -through JEISO. 

■ " . ■ -i 

As mentioned previously, the respondents* role^largely deteianines * 
his or her puxfcose in requesting a search. Table XI shows that users indicated 

..assignments 1[term_papers,_ theses, ^ 

EISO search' (3&%), followed by research/development reports (24%), and 
programme improvement (129?) . these figures contjrast somewhat with the 
reported purposes of their regular information gatfiexing activities ^reported 
in Table IX /. (e. g. no searches were conducted for keeping abreast of the 
field), suggesting that EISO is seen as being well suited for particular k inds of *- 
information gathering and not others. - .. ' 
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TABLE XL. Purpose "Of Search 



Purpose of search - , 


Number 


. Percent 


Keep abreast of field 


0 


0 


Term paper i 




"" 36.1 


Bibliography ^ 


5 


' ■ -4,1 


Curriculum development *' 


9 


7.4 


Programme improvement 


15 - 


12.3 


Preparation of speech, article, report 


6 


4."9 


Research/development project 


29 


23.8 


Browsing 


1 - - 


0.8 


Personnel recruitment, evaluation 

supervision 
Policy develqpment 


2 

9. 


1.6 
7.4 


Other ' ' . 


2 


1.6 


Total '" ' *:/ 


-122 


ioo :o 



ERLC 



125 
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Concerning the personal dimension of the users 1 organizational functions, 

the highest degree earned by the respondents ranged f ram bachelor's (37, or 

*• ■ . %. 

339& to doctorate (19, or l 1 t% < The largest segment <f users reported the 
master's degree as their highest academic degree (58, or 51%). 

Most of the users (31, or 26%) had been in their current positions for 
from four to six years, whereas the next highest group of users (24, or 20%) 
had hHd their positions for less than one year. Overall, however, 63 (52%) 
had occupied their positions for from four to ten or more years (Table XII) . 



TABLE XII. Number of Years in Current Position 

^ L_ - : 



Years * 


Number 


Percent 


Less than one year 


24 


19.8. 


1 year. 


10 


* 8.3 


h\2 years 


12 ' , • 


/ 9.9 


3. years ' 


12 


9.9 


1 4 to 6 years 


31 ' ' 


25.6 


7 to 9 years 


21 


17.4 


TO or more 


11 


9.1 


Total 


121 


100.0, 



To. the question, "Have you ever been an officer of a professional 
organization?", 79 (66%) responded that they had, while 40 (34%) answered 
in the negative. Ninety-three (78%) of EISO's clients were members^ a profes- 
sional organization other than those required by provincial*legislatioti, - 

Sixty-three (529ft of the users indicated that they had written prof es- 
sional papers for publication or for presentation at conferences in the last 
five years; 92, or 76% of the users stated that they had participated in an 
educational research project during the same period. ^ ^ 
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The age group of EISO users ranged from 2£ or under to the 56 to 65 
age group. The largest number of users (53, or 45%) were in the 26 to 35 
age group. Ninety -nine users "(93%)" were in the 26 to 45 age group. The majority 
of the users were male (85, or 75%), with 29 (25%) being female. - 

Environment. The third type of social characteristic of importance 
deals with the environmental factors' which influence the kinds of information 
requirements that individuals in organizations might have.. Fifty-nine users. 
(48%) "listed l^etro Toronto as the location of their organization; 23 (19%) said 
that their organization was located in a county or regional municipality, and 
17 (14%), in a district or district municipality. The organizations of 11 (9%) 
of the users were located in London; of seven (6%) in Windsor; of three (2. 5%) 
m Sudbury, and of one (0 .8%) in Hamilton. 

One hundred and three, or 85%, or the respondents reported that their 
organization was located outside the Northeastern Region (Region 3) of Ontario; 
16, or 13. 2% indicated that their organization was located in Region 3, arid 
two were not sure. 

Asked whether the community served by the user T s organization was := 
mostly rural, equally rural and urban, or mostly urban, 57 users (47"^ replied 
"both rural and urban", 56 (56%) indicated "mostly urban", and only nine (7^ 

v • . - - . ■ • • if- 

"mostly rural". . 

The next item applies only to school boards (central board office, as 
well as schools) . Out of 51 valid cases, 48 respondents stated that the mdther 
tongue of the majority of students served by the board was English; two (3. 9%) 

that it was French, and one, that it was 50% English, 50% French. . - ; - 

. ^ ";s- -• . • : * ; •" . " 

Psychological Perspective . - ^ ..••»"• . . 

- • ' ■ ' •.< •:.»_•'-: j ■ - •', - • * • ■-" • . : 

Motivation to learn. The first important psychological variable to be 

examined is the*adividual r s motivation to learn. Since the need for\^hievement . 

* * '• ..." ■ . 

is seen^as a motivating factor in seeking information., EISO clients were queried 

concerning their professional plansC The majority of users (56, or 52%) 
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indicated a desire to obtain a more senior position within their organization 
during the next five years; 33 <31%) stated that they were not interested in 
advancing ito a higherposition, with 19 (18%) saying that they had not yet come 
to a decision. When asked whether they ^planned to. undertake additional study 

-toward a higher degree, 42, or 34% replied that they were not sure; 40, or 
34% replied that they were not seeking a higher degree, and 37 (31%) answered 
in the affirmative. 

The respondents' opinions and attitudes about innovations were obtained, 

-and appear in Table XHt -. — — — — — 



TABLE XIII. Users 1 Opinions about Innovations 



Opinions 



■ * . JDis- 

Agree ^ agree - No. 

some- Don't some- Dis- valid 

Agr^e what know , what agree cases 



Most innovations in education 
Q today, such as initial teaching 
alphabet (i.t.a.), electronic 
calculators in classrooms and 
the credit system/ are really 
worthwhile and^ help children 
"tQ.-learn better . 

Colleagues often ask me" for 
advice about their professional 
problems* 

I am one of the few people in my , 
^organization who is continually >■ : 
trying out new ideas in his work. 

Most educational innovations today 
cost more money than they are 
worth. - 

Only local school people know 
what theix educational problems 
and needs a^|, not outside experts. 



14.4% 57.6% 6.8% 12.7% 8.5% 118 



38.5 52.1 



9.5 31.0 



2.5: 15.3 



1. 7 



3.4 



4. 3 
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,.10*. 4. 26.1, 5.2 13.9 44^3 115 



5.2 21.6 32. 8 116 



0.8 . 33.1 48.3 118 
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A significant number of respondents (85, or 72%) agreed, or agreed 
somewhat, with the statement that most innovations in education today are 
really worthwhile ;^10 6 (91%) of the respondents also agreed either fully or 
somewhat, that their colleagues often ask them for professional advice. The", 
typical EISO user did not see himself as being one of the few people in his 
organization who continually experimented with innovative ideas. Sixty-seven 
(58%) disagreed either fully or to some extent. Only*12 (10%) were in complete 
agreement that they were unusually innovative, while 30>^op^6%, agreed 
somewhat; Six~users did not wish ^ comrcrifr themselves~and,- therefore, fl — — — 
checked the "Don't know 11 category. Most of the respondents (63, or 54%) 
disagreed or disagreed somewhat with the statement that most educational 
innovations today cost more money than they are worth; the corresponding 
figure for those who agreed either completely or partially was 38 (33%).; Six 
were undecided on this point and said that they did not know. All bubjfive of 
the respondents clearly stated their opinion -on the assertion that only local .. 
school people know their educational problems and needs; the majority^ 
clients (57, or 48^, disagreed; 39 (33%) disagreed somewhat; - 18 (15%> v 
agreed slightly and only three, fully. 

The users 1 initial attitude toward EISO, a specific educational innova- 
tion, Was requested. The largest number of respondents (62, or 529?) said that 
they expected it to be somewhat helpful before actually trying the service and 
53 (44%) reported that they expected it to be very helpful; only five, or 4%, 
diet-not expect it to be very helpful prior to requesting a search. 

'The last characteristic of. user s being considered in. this context is 
whether an individual is a first time or a repeat user of EISO. Ninety -two 
(76%) of the- questionnaires were completed by clients who had not requested 
any searches previously. (This figure includes, of course, the trial use of 
the service by repeat users.) Twenty, or 17%, had used EISO once before; , 
six, or 5%, reported two previous ^searches, and four (3%), three to five * 
previous searches. The total number of prev^S^ searches amounted to 30, 
or 25% of the -total number of searches for which Questionnaires were returne^. 
These data suggest that one of ^every three searches is by an experienced user.; 
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Economic Perspective , 

Sources of funds are considered here as user characteristics, since 

they are determined" by user roles^^^re seen as a user's response to the - 

system. Clients paid for searche^^^CT^^rial&^ either in cash or they were 

invoiced. Of 95 customers who we^^^^^or^ arches, 74 (78%) of the 

respondents received invoices, i4>'prefe*ife'& ta?pay in cash, and 7 were 

■ ■ * . '." *r • ■ ■ ■ - . V ' . 

charged, using the OISE internal charging system.- ' EISO pai4 for 27 (22%) 

of the searches; these were conducted as samples for demonstration and 

-publicity purposes^-or~ were allotted- to-bbards- and.-Other- agencie s in the.-,— '- 

Northeastern Region of the province. Forty searches were paid for by the 

requestors themselves; v36 by -an organization,' 19 by OISE. The type of 

payment for materials ordered was reported as follows : cash, 17; invoice, 

six. Concerning materials ordered^ requestors paid in seven cases, organiza- 

tions in 13; OISE was -listed three times.* • : V • 

Level of Satisfaction. 

* • > . 

The primary end result of a search, as far as this assessment is con- 
cerned, is the users' opinions about EISO and its products^ These opinions 
are needed to define the success pf the service. Users were requested to 
rate the service on a number, of scales. Responses are grouped according to 
the various perspectives previously "discussed. ; ■ 

■ *■ ■ . - . 

Sociological - * \ w " > > : 

r The purpose for which a searchfwas conducted was seen as an out- 
gro^h of the mdiyidijal's role in an organization^ Table JGEV reports how 
helpful a given search was for meeting the various purposes for which informa- 
tion was sought. As with all tables presented in this chapter, the results 
s ummar ize the fl averageLLuser. More detailed analyses are neededto compare 
the helpfulness of information against the purpose for which the information 
was sought. It is not surprising, for example, if information collected for one 



purpose is not useful for- another. As a result, many users marked a 
particular purpose is "not applicable". This is the logical response to make 
, if pne had conducted the search for some other purpose. However, it is clear 
tha$ not all respondents were logical; for example, only two reported searching 
for information to assist in recruiting or evaluating personnel, yet 41 rated the 
information received in terms of its helpfulness for this purpose. 



TABLE XIV. Helpfulness of Information Provided as a Result of EISO Search 



Purpose of search 


iNOt ax 
aU 


Some- 
what - 


Very 


v aixo. 
cases 


Keeping abreast of the field . 


7 

7.0% . 


58.6% 


34.3% 


99 


Completing assignments, theses, etc. 


20.8 


28.6 


50:6 


77 


Preparing or updating a bibliography 


24.0 


37.3 


38. 7 


75 


Curriculum development 


37.5 


46.9 


15:6 


64 


Improving programmes * 


28. 8 . ' 


57.5 


13. 7 


73 * 


• 

Preparing a speech, article or report 


29.3 


45.3 


25.3 




Undertaking or completing a re search 


19.8 


44.4 


35.8 K 


81 


...or development project 










Browsing 


' 36.1 


42.6 


21.3 


■> 61 


Recrtiiting and/or 'evaluating personnel 


78.1 


9.8 


12.2 


41 


Developing policy 


38.5 


44.2 


17.3 


52 



■ 1 . 



Information provided by EISO for each of the following four categories 
was considered to be most helpful: keeping abreast of the field (93% rating it 
somewhat .or very helpful) ; undertaking or completing a research or development 
project (80%)- completing assignments, term papers, theses, etc. (79%); and 
preparing or ^updating a bibHography (76%), In descending order > information 
provided by searches were also helpful for improving programmes (71%), > . t 
preparing speeches or articles (71%), browsing (64%), dirriculum development 
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(63%) and policy development (62%). Information was of least value for recruit- 
ing and/or evaluating personnel (22%). Again it should be emphasized that a 
significant number of activities were termed n/a (not -applicable); for example, 
oniy 51 of 122 respondents (42%) used the information they retrieved for \ 
policy development. Overall, the majority of users were of the opinion that 
the information provided as a result j^f their EISp search was helpful* ' 

Users were also asked to indicate the value of the bibliography itself 
and of the materials located through the bibliography. Eighty -nine users 
" (82 % of thos^ r medium^ ~~ 

the corresponding figure for the value of materials located being 73 (85%) . 
Conversely, 18% and 15%, respectively, expressed a low level of satisfaction 
with thi value of the bibliography and materials (Table XV) . Kecall 'that ^44% 
had expected EISO to be very helpful, and only 4% not helpful at. all. It appears 
EISO fell somewhat short of expectations, perhaps because of the lack of 
materials on certain topics. 

TABLE XV. Satisfaction with Value of Bibliography and Materials 





Satisfaction 




No. 
valid 










. Low Medium 


High 


cases 


Bibliography' \ 


> 

17.6% 46.3% 


36.1% 


118 


Materials \ 


15.1 46.5 


38.4 


86 



Psychological . ' ' 

■ The individuals own perception of how much knowledge he or she 
gained on the search topic from using the EISO search service was measured. 
/The majority of users (62* or 54%) indicated that they had acquired somja 
knowledge about the topic that was searched; 35 (30%) had learned a great 
deal, and 18 (16%) nothing or very little. 1 
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To this item must be added two 'other items from the Data Slafeet: 
the average number of references expected by the 42 individuals responding 
was 355.8 (minimum 1, and mkximum 2000), and the. mean score for the 
number of relevant citations already known to the 26 users responding to this 
item was 13.6 (minimum 1, and maximum 99) . Clearly, in most cases the 
user did not know what to expect, and was unfamiliar with existing references. 

In order to determine whether the users 1 information needs have been . 

/* ■ 

met, EISO clients were asked to indicate whether they desired additional in- 
formation on their particular searqh-topic.— Againr the largest numberr^f users 
(53, or 47%) stated that they still dfesired some additibnal information, 37 (33%) 
expressed the desire to seek a great deal more information, and 24 (21%) indi- 
cated that their information need had been satisfied, by replying nothing or 

very, little. ^ 
In another area which deals with knowledge gained about EISO itself 
as a- result of the search, 69 (59%) noted that they had learned a small amount 
("some"); .28 (24%) that they had learned a grjsatd^al, and 20 (17%) nothing 
or very little. It appears that either EISO is so* easy to use that it can be used 
without the individual learning much about the system, or that the publicity 
was very effective in explaining the system. 

Satisfaction ■ - 

Thirteen items directly relate to the users' satisfaction with four 
aspects of EISO: publicity materials, quality of service, timeliness of service, 
and quality of technology, as shown in Table XVI. Respondents were asked to 
check n/a if the question was not applicable.- 

The level of satisfaction with publicity materials and directions was 
found to be high (from 61% to 76%). EISO users were moist satisfied with the 
adequacy of directions for submitting search requests to EISO: 88 (97%), 
all but four of those to whom the question was' applicable, expressed medium 
or high satisfaction. Low satisfaction was expressed by more than 10% only 

with regards to the directions for ordering materials; these directions have 

• ■ - -* • * 

now been improved.. % 



TABLE XVI. User Satisfaction 



Satisfaction No- 
valid 



Aspects of EISO Low Medium High 



cases 



PUBLICITY MATERIALS & DIRECTIONS * ' 

Accuracy of publicity materials, 4.1% 26.0% 69.9% 76 

EISO presentations, etc. . w 

Comprehensiveness of publicity 7.5 31.3 , 61.2 67 
materials, EISO presentations, etc. 



QUALITY OF SERVICE 



C 



Adequacy of directions for submitting 4.4 19.6 76.1 ■ \ ~ 92 

search requests" to EISO / " 

* • ■ 

Adequacy of directions f&v ordering 13.0 26. 1 60 . 9 - 92 i 

copies of materials ^ - 



- Convenience of arrangements to_ 2.6 13.8 83.6 _ 116 

obtain EISO v search^ s 

Helpfulness of search' analyst or -^1/7 7.8 90.4 115 

Educational Information Consultant . • ^ 

Time devoted to search interview with 5.0 15.8 ^79.2 109 

search analyst or Educational In- . / 
.. # ■ formation Consultant 

TIMELINESS OF SERVICE . ' . ^ * 

r . : : . ■ . * 

Time taken to deliver the EISO 8.3 . 21.3 70.4 ■ 108 

bibliography - m \ 

Time taken to deliver microfiche or 36.8 21. 1 " 42. 1 19 

" paper copies ordered from EDRS * 

in the U.S., if applicable , . ./"«■"'. 

Time taken to deliver microfiche or \ 15l2 *■ 27.3 ^ 57.6 . 33 

paper copies ordered from EISO \ m - • ; . 

QUALITY OF TECHNOLOGY. ■ 

Length of bibliography . 9.9 35.4 54.9 111 

Readability of microfiche copies, l8f~4 44. 7 36.8 - 38 

if applicable V " 

Availability of microfiche readers ; 9.Q . ■ ■ 21. 8r * 69.2 78 
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Quality of service was rated highest among the four aspects of EISO 
considered. The helpfulness of the search analyst (or EIC) was rated as 
extremely satisfactory by 90% of the respondents, followed closely by the 

convenience of arrangements to obtain EISO searches (84%). Satisfaction with 

■ « 

time devoted to search interview was high in 79% of the cases. 

In spite of the fcrol&nged postal strike last autumn which caused lengthy 
delays, users felt that the turnaround time of the 'EISO search was more than 
adequate, for their neecfs; they were particularly satisfied with the time taken 
to deliver the EISO bibliography (70% indicated a high level of satisfaction, 
21% medium, and 8% low). The remaining two items dealing with time taken 
to deliver documents^ from either EISO or EDRS did "hot apply to 71% and 83% 
of the respondents, respectively. Where applicable* the users indicated that 
-they were satisfied witii the length of time from request to receipt of micro- 
fiche or paper copies from EISO: 85% checked medium or high. However, 
they were slightly less satisfied with the time taken. to 1 deliver EDRS materials 
from the United States, 63% checking medium or high. The remaining' 37% 
indicated, low satisfaction, a proportion, that might be considered too high to 
be acceptable. Clearly, delivery of copies of original materials is one of the 
most cMfittcult procedures in operating an information system. 

The last aspect, quality of technology, also shows quite a high level 
,of satisfaction, with the possible exception of readability of microfiche copies 
(if applicable) . Here*14 (37^ of the usens said that they were highly satisfied, 
i7 (45%) indicated medium, and seven, (18%) tow. They found the length of the 
bibliograpKy^very reasonable: 92% indicated their level""of satisfaction to be 
either medium or high. In addition, users were very satisfied with the avail-* 
ability of microfiche readers; the medium or high category comprised 64% 
of the respondents. _ 

Thus, 'apart from very few minor reservations, the vast majority of 
users were 'highly satisfied with the service aspects of EISO, _which seems to 
indicate that they considered use of EISO to be a worthwhile'and rewarding " 
endeavour*- < . ' y ' - 



. ^Finally, users - were asked to* respond to three summative questions 
about EISO which fall within both the sociological an<d psychological frameworks. 
Of the 103 respondents, *85% noted that-they,would-use EISO again; 18 said 
perhaps. An even higher figure, 114: (95%j of the EISO clients stated that they 
would recommend the service^to a colleague; five said that they would perhaps 
do so, and only one, that hej^uld not* Furthermore, 106 (88%) of the clients 
recommended that the ,EI30>&earch service be offered on a permanent Basis. 

These last three very positive responses bring this user description to a- 

... - • ■ • • ■% * • ■ 

fitting and hopeful conclusion. 

Economics of Operation * •''•'•/' 

C Considerable human, financial, and material re source s are required 

for EBO T s operation. I?revious chapters have related the nature d£ the first 

of these, particularly the "training of Educational Information Consultants and 

the staffing of EISO. As well, attention has been given to the records system 

with its large number of forms, to the creation- of a suitable, work area, and 

- . •>•- '■ . ' ■ 

to the purchase of equipment. This section is concerned with the actual de- 

•* ** ** 

ployment of these various resources expressed in dollar terms. This topic 

-is the first phase in conducting a financial analysis of the Educational Infor- 
mation System for Ontario. " 

Human Resources ^ 

Training- and maintaining a network of Educational Information -Consul - 
tants is a, considerable undertaking, and the effort is warranted only if their , 
assistance is regularly sought by EISO clients.. To learn the extent of this 
usage, clients were asked whether or not an EIC had assisted ta developing 
their search request.. By far the largest component of users <94 or 78%) 
responded that they had not consulted an EIC, but had contacted the. search 
analyst directly. Seventeen, respondents (14%) replied that EICs had, in fact, 
assisted them in formulating their search request; of these; 11 (99?) were 
assisted by Field Centre 'EICs, one by a Faculty of Education EIC, and five 



by a Ministry of Education EIC. Five respondents were not certain, . 
while four listed "other"- Given that EICsj are available in an area con- >■ % ?f 

taining a small percentage of Ontario 1 s population, these figures look - ; 

e- • • - ' ■ " * • ^- 3 ' ■ 

"encouraging. •> - ./ ,- . 

* • - . 

The nature of establishing initial contact with the search analyst 

was recorded by the search analyst on the Data Sheet. In 74 instances - : 

(61%) the client" came in person, in. 34 (28 9£) the users telephoned* and 

in 18 (15%> search requests were sent by <mai1. 

. " - ' - % - 

Since modex of delivering bibliographies included delivery by the 

■ L : v - •' . -*: . ->" .* ■ ••: v • /• 

EI C or search analyst, this variable reflects the human side of th e: sea rch 

service 1 as well. Sixty -three (54%) of "the ^bibliographies were mailed to 

EE^Asearch- analyst,, who then contacted the client so that the bibliography 

could be picked up. Forty -eight (41 9^ were mailed directly to the requestor; 

two we're sent to an EIC for delivery, and three were sent to "other". 

. • • • . \ • ~ ■ < ' •■ ' •". -' ... /' " - 

Technological Resources ; , / " 

The particular computerized search system vised and data base searched 

for processing a given : .request arejwo major technological items of interest. 

Of the 122 searches reported in the questionnaire data, 104, or' 85%, were; 

executed on the search service provided by the System Development Corpora- 

tion; rthe rem aining 18 searches used Lockheed. In llS.cases,^ 95% of the 

total, the ERIC data base was searched. , Psychological Abstracts was searched 

five times and Social Science Citation, Index- only once, T *. ^ 

. Users were also asked to indicate the availability of microfiche readers; , 

without fiche readers, it is unlikely clients would order microfiche copies of. \ 

ERIC documents from EISO. The greatest number of respondents (81 or 689$ 

noted that non-portable readers were available, as for .example at the' OISE ^ 

Library. Sixteen (13%y xeported-having access to a portable reader in their V 

• - ;• • • • . . • *. • ■ ' * • *■ • •$ ■ - 

organization. Eighteen users (!L5%) had no fiche reader available, and four 
were unsure. * 



Two individuals stated that a fiche reader supplied by EISO was avail- 
able to them. 3 These individuals were frjom the Northeastern Region of Ontario - 
where a small n umb er Qf microfiche readers were distributed to ensure - 
miprofiche readers w^re available to some users iiL that area.. 

* : \ ' ■ ^' '• ' y ■ ■ . * : 

Cost of-EISO Services - -. ' 

" Cost of "EISO services, refers to the actual costs incurred by the search 
service to conduct*business — as distinct from the prices it charged users. 
A formula indicating a few of these costs — staff, computer time, and printed 
bibliographies ~r was presented in the previous chapter ; namely, ^ 

Search costs = c 1£ (c^ Cg) t g + pn . * 

where -c and c are the costs of search analyst salary and computer time, 

* respectively, t^ the time spent for the first- discussion-only phase of the search 
negotiation interview, t^ the length of the second phase of the interview during 
Which the searcii analyst is on-line with the computer, "p is the, cost of printing 
one citation, and n is the number o^itations printed. Note that all overhead 
costs are excluded,, - w 

Datsrfrpm the 122 cases analysed for this report yielded ^flie foUojpring 
average values: c = $0. 12 per minute for the search analyses salary; c = ■ 
.$0. 85 per minute for the search service ($51.06 per hour) ; t = 27.1- minutes 
for the first phase of the negotiation interview; t' 2 = 12. 2 minutes for the second, 
on-line phase of the interview; p = $0 . 12' per" citation printed; and n = 67, the 

average number of citations. . : . s . - 

f \ Hence, the total cost of the average search — - excluding overhead — 

• • '• " . * . . '. - - ■ ■ ■<•'. 

was $23.12, with the costs of phase one equal to $3. 25*. phase two to $11. 83,' 

and the bibliography, $8.04. \. 

. r Substituting the maximum observed values for each of>fte variables in 
the formula above gives an upper limit for the direct cbsts associated with 
doing a single search. These values were: = $0.12; c^ = $1-. 33, t^ = - 
70 minutes, t = 53 minut es, p = $0J13 and n = 1.97 citations. The total direct 
cost amounted to $110. 85. * . \ . 



A similar figure for the minimum direct cost for a sear.ch equalled - 
only $2.10. Clearly, direct costs for searches .can vary .widely. 

. . It must be emphasized that .all costs above exclude overhead* record 
keeping, space, Staff time when a search is not underway, and depreqiation v 
of equipment. ^ Additional research is ne.cessary before an accurate estimate 
of the full cost of a typical search is possible. >V 

Quantitative data relative to the number of documents ordered from EISO 
and EDBS were also collected. The average number of microfiche copies \ ; 
ordered from EISO, for those 21 who actually placed orders, r was nine; /the . 
average number of copies of journal articles for the 20 using this service was > 

^ . • ■ • : - : - • - - : r - ' .;. ■ s 

3.-5; eight individuals" ordered an average, of 2. 8 copies of ERIG paper dqcu- ... 
ments from EDRS; and two ordered an average of 13 microfiche copies from* 
EDRS. : — " " . ' Y - • 

No data were collect ed on which to base an estimate of the full cbst y . 
of providing microfiche and paper copies. This topic will be the focus of a 
future, investigation. " ..." £j. ; * - 

Prices Charged foap EISO Services : ' ' • 

^ ^ * The pricing structure used by: EISO, it will bp recalled, set $3.0 as the 
fee for; a search in most parts of Ontario, and $20 as the feerfor user & from 
the iTortheastefn Regiort^^ Exceptions included a $15 fee for students^ at OISE 
during Summer Session 1 9 75 f and f re'e.4otroductbry sear ches for educators 
in the Northeastern Region. s y - . y ■ '■ ' r ^ 

/ The average price actually paid by users respondiiig io the questionnaire 
was $20. 57; the average price for their first search was $20*08 — a slightly 
lower figure than the overall averse price since free searches were often 
available for trial use of EISO. The relatively small difference between the 
two figures reflects the fact that most searches reported by survey; respondents 
were in "fact firs^ searches. Note that the* average price per search waus below 
that of the average direct cost. Hence, even excluding overhead, the typical 
EISO search was conducted at a loss. 
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. » . : . ... ' ' - • ' . 1 - 

Prices Xor microfiche and paper copies were set at 35£ aiid;10£, respec- 
tively-. No data were collected on the . actu^charges since no users received 
copies at r educed rates • ^ " . 

EISO Publicity 0 v v . "* ■ , 

A final technological variable, shown in Table XVn* deals with the t~ 
effectiveness of EJgpi publicity materials in informing potential clients about 
the availability of the search seij^vice. r Thirty-five respondents (29<%) learned 
.about EISO though the brochure (or flyer), "and 34 f^pm a colleague. - 

- e ' . . ■ ■ . ■ • ' . 

TABLE XVII. How Did Respondents Learn about E3SO 





^Method 


- Number 


Percent 




. Brochure^ 


35 


28.9 




■ Article . 


1 . : 






Professional Development Day 


; "; - l 


0.8 . 




Classroom instruction ^ 
Colleagues - • , '■ - 


9 " 

V.^V.34 - 


- ' : 7.4 
28.1 




' EIC • . " 




4.1 




Library tour f 


1 * 


/; ' 5.0 1 




-Cannot recall / 




' 5.0 




.Other 'V V 


24 


19.8 


J' < 


^ Total 


121 


'100.0 











N 



Among, the "other" effective methods of communication given w&re: 
librarian, seven; OISE faculty, five; prindipal investigators of EISO, four; 
announcements at OISE Field Development Standing Committee meeting, three; 
and presentation to staff at the Regional Office of the Ministry of Education, 

or at Principal Teachers f Meeting -in Northeastern Ontario (Region 3) , three . 

*' ' * . . ". 

Two sources were not identified. *"N - 
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- . . Summary 

Assessment of the Educational Information System for Ontario during 
its first five months of operation provides an initial -picture of the type of 
client it is attracting, the effectiveness of its services, and some of the costs 
of <joing business. Fbjt more data are needed on these and other topics before 
sound conclusions can be reached; however, the emerging images are en— 
cpuraging; . - • 

The next and final chapter' of this ^report provides an overview of the 
findings to date, and suggests their implications for the immediate future y 
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CHAPTER XI 



Summary and Implications 



Who uses EISO? This is the fundamental question addressed in this / 
report. It can be answered by sketching a -profile, of the typical individual 
who submitted a search request, as represented by the data reported in the 
preceding chapter. Is EISO a viable operation? Certainly it works, that 
much is clear from the data, ^owever, only a guess^can be made concerning 
its long -term fiscal viability. Elaboration of the findings concerning these 
two issues form the body of this chapter, which concludes with a brief state- 
ment as to the implications of the results. 1 

. ' . Profile of a User : . * r.~ 

- Tlie person who consults the EISO search analyst — • most users 
visit in person — is most- likely a man in his mid-thi rties . Chances -are he : 
Is with a school board in the Metropolitan Toronto area, or a doctoral student 
at OISE, having already completed an M. Ed. He has been involved in research, 
has written papers or. presented talks, and wants to get dhead;. He' has aposi-. 
tive attitude toward educational innovations, but is modest concerning his role 
as an^ expert in his own organization. He spends a/ great deal -of time gathering 
information from colleagues, and at least two hours a week reading to keep 
abreast of the field or for dissertation research* If he Is from a school board, 
he is interested in programme rimprovement and. curriculum development. 
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When he sits down with the search analyst, the client is probably 

interested in a specific topic for a specific purpose. While he may browse '•- 

or read to keep up with ch ang es in the field, he comes to EISO for inforina- 

..... -■ - ■ ■ 

tion to be used in research and development, progra mm e improvement or 

academic assignments. Chances are, this is the firs&time he has tried this 
new, innovative approach* to retrieving information. He first read about the 
service in a brochure or heard about.it from a colleague. He will be a satis- 
fied customer and will willingly pay $30 for a search and bibliography of 
approximately 70 references (or, more precisely, ^ 8 orgaiiization will be - 
invoiced). He will be particularly impressed with the skills and assistance 
of the search analyst. '„ ■ 

If he orders materials from EISO, which only one in six clients do, 
he will select the three or four best articles for paper copies and nine of the - 
best documents in microfiche form. Of course, he may prefer to use the OISE 
Library or his boards professional library instead of placing an order. Over- 
allr he7will.be quxte satisfied with the promptness of the* service and ease of 
order ing searches' and materials, though he may find the microf iche he receives 
a bit difficult to read. If he decides to order paper copies of ERIC documents 
from the United States, he will not be nearly so satisfied with the promptness . 
and ease of ordering* In most cases, though, he will have access to a micro-, 
fiche reader and will order microfiche~xhstead. 

After using the information retrievea^through EISO, the client will still 
want more information about, the topic he searched, even though he is fairly 
well satisfied - with the bibliography and materials. 

In all probability, the client wili relate his experiences with EISO to 
a colleague and he may even volunteer to write a letter supporting the con- 
tinued availability. of the service, since he is enthusiastic about the service 
and hopes that it will continue. - 



The social and. psychological profile of the user,: according to the data - 

provided by the questionnaire, is identical to the profile of adopters of innova- 

: . ' ... '•• ; . , ..- / ... ./ . 

tions, a topic well described in £h^ literature . Socially, users are hi^i 

status individuals: men in their prime with a good education and upwardly 

mobile in their careers,/ who interact a great deal with colleagues* Psycho- ; 

logically, they are experienced learners who know how to seek information - 

and how to use it. Their roles in urban organizations provide an impetus, a 

motivation to acquire information for re search, programme develppment, or 

.whatever. Their ambitions and attitudes toward innovations accentuate these 

motivations^ They are, in short, early adopters (Rogers, 1962). 

/ Economic Considerations 

To know if EISO is viable, one must know in full detail the cost, quality, 
and demand for the services provided- BecaHseJfche service is so new, it is 
difficult to discern what the cost and demand would be for, a well-established 

o . / • . * ...... 

system. <> ; ^ ■ : i. . 

The cost data provided by the questionnaires and data sheet's are I 
selective and only minimal costs are included — those for computer time, 
citations printed, and search analyst 1 s time. ; Costs for these might even be 
lower limits for what might occur in a regular service since the search 
analyst employed for the project is very highly trained. A slower, less 
efficient analyst could waste enormous, amounts of computer time while cor- 
recting errors or making unnecessary changes in search strategies. Finally, 
-no overhead costs have been collected. Costs-for space, lights, heating, 
supplies* depreciiation of equipment, processing of records, collection of 
charges, losses due to non-payment,' and the idle time of the search analyst 
have all been excluded from this analysis. \ " A / ■ * \;y 

The cost of providing microfiche and article duplication services is 
even less distinct than is the case for search costs. Supplies, for .duplicates 
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are inexpensive, but the costs of labou-p in locating and reshelving library 
materials, or processing order forms, and of making copies have not yet been 
estimated* - — ^ 

Implications ; . , .4**? 

Several tentative implications can be drawn from the preceding summary. 
• First, it is clear, that the typical EISO user is not representative of the edu- 
cational community taken as a whole. Few users are teachers, although 
teachers represent an overwhelming' majority of educators. Only one^uarter 
-cjE the clients are women, whereas women represent a. majority of educators. , 
Clearly, to test the viability of EISO, it is necessary to direct publicity activi- 
ties tbward those individuals most likely to uffe the service: middle level 
administrators in urban areas, and advanced graduate students. ' 

. Second, it is too soon to make conclusions regarding EISO* s ec6nomic\^; 
viability; insufficient data are available for analysis. Six months of operation, 
a period which included a long postal strike, is too short a period on which to 
base projections. . The system needs an opportunity to operate hear full capacity 



for sufficient time for adequate data to be collected on both direct and indirect 



costs. 
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fS^f ll™^' rlZtL^ APPENDIX A- Ministry of Education Contract ' 



1974/75 Research Contract 

- * EDUCAT I ON AIj INFORMATION SYSTEM FOR -ONTARIO J 

1.0 CONTRACTING PARTIES : 
■ ... This .contract is between: 

1.1 'Her Majesty The Queen, in- ther, "tight of - Ontario, represented 
\ by the Minister of Education, Ontario (hereinafter called * 

The "Minister") of the first part, and 

1.2 The Ontario Institute for Studies in Education thereinafter 
. fc called n O,I*S.B, w ) of the second, part. — 

2-0 SCOPE OF RESEARCH : ,>.".• 

> — ~~ I — : — " — ~~ — ? • . 

This fs a contract 'for research services involving a study of 
■■: an Educational Information System for Ontario to be undertaken > 
for the Minister of Education by O.I.S.E. 

The research undertaken shall: 

** * to . * 

2.1 study the nature and levels of demand (including the . - 
~\ factors affecting the demalnd) by educators of the Province 

for access to a generalized information base of educational 
resources through the use of the . existing ERIC * data/base 
T service. ' ; * ■ . ■* «• • " 

■ :." - '/ ■* ■ ■ ■ \» ..... ■ ^ . - 

2.2 develop and* refine methods of placing , search orders, order"" 
delivery, and advertising the availability of such a service 

2.3 examine the technical and fiscal viability of the . interactive 
on- line search techniques (in contrast, to ba teleprocessing - 

- methods) as a service^ to educators , "students , and researchers 
in the Province. - 

2.4 study the impact of th£ use of such a service upon the nature; 
^ and levels of demand for "the use of micro-fiche and hard* copy 

~ forms pf da#a and to assess the effectiveness of such new uses 
as may be identified. Cost effectiveness elements of the use 
of micro-fiche vs. paper copy shall be included. 

2.5 determine the manpower and ^technical requirements to match a 
given^level of demand for such information services in the 
Ontario setting. •, ' v 

2.6 research and .evaluate the level of user satisfaction by 
category of users and to analyse how such data/information 
is - being used. r 

2.7 study the fiscal viability of the operation of an "information 
system of the ERIC type , through using varying -fee, levels ' . 
relating to -user volume. The study "shall include an assess? 
ment of incentive devices such, as the introductory search 
without user fee. * ^ . 
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> ■ . 2.B study the effectiveness of an intermediary (consultant) 

- ~, in. interacting with users in a more remote geographic . ' 

setting in Northern Ontario in clarification of search 
scope and in interpretation of output. r • 

*. 2.9 develop and refine strategies of utilizing such" services: 
** -through" existing remote service, facilities , such as a \ 
field office of O.I.S.E. , 1 a regional.off ice- of the . 
* . . . Ministry, of Education, and an Office of a school -board. 

2.10 interpolate the resource requirements were such strategies/ 
services (including those noted in 8- and 9 above) to i be 

•\" extended or made available on a more general basis to 
other areas of^^he Province. 

2.11 conduct a literature search relating to a study of the' ' 
school board as^a corporate user of such a. service; and 
report on such experiences or incorporate, this considera— • 

( tion into " the study, if such does not exist. 

2.12 establish the viability of such a provincial service . 
within a ma»imum- period-of— two_(2)._year:s.._"- . "'»= - 

■ : . • ' • ■ • • ■ . . . - . • * ■. " ' • ' ^ 

2.13 report to the Minister of Education on the above questions 
along with a chronicle of developments* of the service 

' through an interim report at the end of one (1) year/ and a 
final report at the end of. the two s (2) yea^ period. ' 

3»0 DESIGN OF. THE RESEARCH V . , . • . 

"3.1 The complete design of the study indicating its uniqueness 

- will be, forwarded in . triplicate within a month, following 
• the signing of this contract, to the Chief Educational 

- Officer (Research) , Ministry of .Education. / ' 

■■ ■ ' ' ..- . a • • 

' '". * 3.2 P rjreliminary annotated bibliography of related research 
cxtcl literature shall accompany- the design. ^ 



4» 0 RESPONSIBILITIES OF PARTIES : \. , ' 

■ - She responsibilities of the two parties involved in this \ m contrafcn^. 



shall be as follows: . * J| 

' m .'t"-' 

■ 4.1 The Minister shall provide the ^necessary research fdnds an 

a/Supervisory Official for the " investigation • 

• 4.2 The O.I.S.E. shall provide the Principal Investigator and 
support personnel, to oversee and execute the project, 
• administer the funds provided by the Minister of Education", 
and follow the procedures outlined in Appendix B- 

5. tf PERSONNEL INVOLVED : * V . 

The personnel assigned to the projecjt shall ibe: 
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5.1 The Ministry of Education, represented by the Chief 

Educational Officer (Research) - Dr. E. J. Quick; and' the * 
Educational Officer (Contractual Research) - Mr.^W. C. Taylor. 

v . '■ . s ■■■■■■ ■ ' • ' \ . 
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9. 



5.2 For the Ministry of Education/ as Supervisory Official - 

- Mr; Donald Rose, Educational Off icer , Curriculum Services 

' - Branc^i. . \ 

5.3 For j^ie 0.i;s.£. as.Principa^! Investigators - . ' ' 

: Dr.^S. B. Lawton, raciofcant Professor, and > '■■ . 

E. Austere Head - Reference and Information (Library) r 
and support personnel. 

- ; ? <*y ~ V* , ■ * . • J ' . " : - . "'. . * .'. ;r ' / * 

6.0 PUBLICATIONS AND REPORTS r 

6.1 The copyright of any publications and reports made as a 
result, of the research project herein provided for or 
produced in accordance with this agreement shall be the 
property of the Minister, provided however; that subject 
'■ ' to the prior approval, of the Minister, whidh approval 

may be arbitrarily withheld or limited ih extent, the ^ ' - 
■ % - ^. O.J&.S.E. shall hayfe a right in ~ the nature of a license a . * 
" : - or assignment of copyright to publish any such material * . 
^ in Ontario and throughout the world, but no , such exercise 
of the right of publication by the O.I.S.E. with the 
: approval of. the Minister shall operate so as'yto prevent, v 
• or interfere with^the right of the^Minister to make avail- 
able to students at schools in Ontario r their parents or 
guardians and to school boards and teachers upon * such terpis 
as the Minister may determine/ all or "any of the ^findings 
of tjie research carried out under this agreement* 

"6.2 Subject to 6. ir all reports/ articles., paper s , speeches , 
"etc. concerning, this project prepared^ by the-0.I.S.E.\ : or 
, - its" personnel, shall give prominent recognition of the • ^ 
involvement of the Ministry ,of Educatiofb^ Recognition 
sftall be placed on the title page o£ the final report' r ' 
with the wording; ,^ - , V. ] 

W % " "THIS RESEARCH. PROJECT WAS FUNDED "UNDER CONTRACT 

' ft' BY THE MINISTRY OF EDUCATION f ONTARIO " . 

Prior to th^ release, of the f inal report to the public , 
three (3) copies ;of any report, article , paper, speech, 
etc* concerning this project shall be submitted to the 
■■• - . Chief Educational Officer (Research)" for joermi^sion to 

release to the public. ' : { 

; 6.3 Thirty (30) copies in bound form of all final reports, . 
■- articles, or papers concerning the project are to be 
forwarded to the Chief Educational Off icer (Research) 
for the use. of the. ^Ministry of Education. One .of these 
3 shall be suitable- for reproduction. All reports shall 

be submitted on 8 1/2" x H" " or A4 (International Standard) 
size paper. 

•6.4 An ABSTRACT of 400-?500 words shall fo'rm a part-of the ■ '/ 

• ^ ; ' final report. . b ,.. • . . y 

6.5 Notwithstanding sections**.! and/6. 2 the O.I.S.E. shall^, 
retain the right to make public the findings of this 
q study two -\4.2) years following submission of the final 

rpoort ' to ^fchey Minister . . -. ■ , . \y 
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1ST A/IS Research Contract 

• - » . ■ - * ■ * • ■ 

7.0 FINANCIAL ARRANGEMENTS ; 

7.1 This contract is concerned with all research services, 
as stated in Section 2, undertaken by the O.I.S.E. 

• between 1 March 1975 and 29 February 1976. 

7.2 This contract may be terrainated^by tie Minister at the 
end of any fiscal year of the Province of Ontario 
(March 31st) if adequate research funds for this purpose 
are not available in the* subsequent f iscal year *s budget 
of the Ministry of Education. 
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7.3 The Ministry of Education shall provide, .subject to the 
provision in 7.2 of this contract, a JtoA^aJ* amount of 
$96,169. Payments will be" processed lupon receipt of ap- 

— propriate numbered -invoices-^ 

ments of $14,-000 on each of 15 March 75; 30 April 75; 
' 30 June 75; 31 August 75; 31 October 75; '31 December 75. 
Upon submission of a satisfactory final report and 
numbered invoice on or before 29 February 76, the final 
instalment of $12,169' will be processed for payment to 
. the O.I.S.E. 

7.4 "With each numbered invoice (submitted in quadruplicate) 

the O.I.S.E. shall submit, to the Chief Educational 
■ : vp Officer (Research) a progress report (also submitted in 
■ . quadruplicate) on the project, providing evidence that 
^ the services have been rendered as stated in €he contract. 



7*-5 The budget allocation of the O.I.S.E* for the funds 

involved is to be attached, as Appendix A. ' 

* , * . •..'*■■•■.* 

"7.6 An accounting of the expenditure of the funds shall be 
submitted By the O.I.S.E." within fifteen (15) days of 
.'."**• receipt of .a written request from the Ministry of Education, 

"7.7 The research conducted under this contractus unique ^a&d 
. is not being funded from any other source; ..' ■" ^ 

8.0 CONTRACT RENEWAL ; ^ : „•• . 

8.1 . It is the. intention of the parties involved that this 
contract may Jae renewed subject to the agreement of 
- all parties, and the provision of 7.2 of this contract. . 

: . . 8.2 The terms and format -of this contract shall not be. * 

"jdeemad to establish a 1 precedent for future contracts. ? 

9.0 NON-COMPLIANCE ; . ' , „ 

Should there be evidence of non-compliance with the terms 
of the contract/ this - contract may "be terminated upon ° 
- -j - written, notice" to the party concerned by the Minister* - 
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10.0 AGREEMENT ; 

" ± sfeSLf whKSf tL on ' 

^^2" °£,=^h e P |irs? ^second parts have hereunto, 
lef their'hanls^thrauthorizel officials whose 
signatures^appear below: ^ 
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DATE 




T * KS& / V s/ - - i — : — — ^ Minister of. Education 

Ontario 



f or the Ontario Institute for 
Studies in Education 



An Education. 



Information System for Ontario 



Schedule 
March 1975 -February 1976 

ACTIVITIES . ' ■ . » 

. • - , \> \ 

Establish project in Department Of Educational Adml'nTstratlon. 
Transfer funds from Field Development Standing Committee 

Dool to Department of Educational Administration. 
Identify suitable equf pment-f lone duplicator, reader, 

computer terminal. 
Identify members of 01SE advisory committee. 
Meet with Supervisory Officer at Mlnlstrv of Education to 

clarify Drocedures, contract terms. •. * " 

I nter 1m -report - due at MI nlstry of Educati on March 15. — .' 

Transfer salary . of Principal Investigators to project. 
Create job descriptions for Librarian 11, Library : . 

' ..Assistant 1.1 , Research Officer III. 
Purchase equipment before Apri 1 y 15. 
Determine location of serv-lce in the Ll-brary. 
Arrange -for project room to be built in Library. •• 
Submit research design and annotated bibliography. -> ' ; ' 
Interim report due. at Ministry of Education April 30. 

Hire Librarian I I ', Library Assistant 1 1 j" Research Of ficer 1 1 1 
Establ Ish financial mechanisms, for charqing fees. . y ; 

Desi.grt financial forms. . 

Contract witfuSDC. » . \:/\. 

Submit furniture requisition. ..'.■•=> .< , . . 

Melt with Administrators of target northern Ontario schoo.l 

boards. \ - 

Hlre.TImmins FD agent. ^ 
Identify local "gatekeepers", equipment needs.. 

Begin service June 16. 

Orient project staff to R and I, Library. 

Hold seminars on project for Library staff. 

Informal social evenlnq for R and I and project staff. 

Develop search forms for service. 

Have forms printed. 

I nt.er.lm report, due June 30. 

'Transfer' project files to off Tee in Department of Educational 

Administration (July 2) . 
.Hold seminars on service for Summer Session students^ 

Prepare publicity and tralninq materials. 

Train intermediaries. 

Interim report due August 31. 



EDUCATIONAL INFORMATION SYSTEM FOR ONTARIO 

Schedule , . 

September 1975 - February 1976 

a r. T I V r T I E S 

• : — : ■ j 

>;• Publication of publicity articles in Orbit, 
Ontario Education, etc. 
Mailing of brochures to Ontario educators 

Drafting and distribution of search evalu-, 

ation forms for summer clients 
Printing of revfsed search forms 
Announcement of cost recovery program to 
77 ~ OISE staff and students — 

Draft of User Manual 

Demonstration for Field Development Personnel 
Revised version of evaluation questionnaire 
' Testing of interview schedule 

. Workshops In North Bay 

Interim Report . 

December Collection of data 

Budget projection for second year of project 

InterlTn Report 

^ Collection of data ' . 

:' • - ppel iml nary ana lysi s- of 'data 

• ~ Out I I ne of year-end repot 

Analysis of data . 
• jCeai — end report • 
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Schedule of Activities 



March 1976 - February* 1977 



Month 



r 



Activities 



March 



ApriL 



Detailed analysis of first year's data 
Revise evaluation questionnaire 
Print' EISO user's handbook 
Scarborough PD days 

Report detailed analysis of data 

Plan interview schedule 

Plan- analysis of- negotiation —session- 

interviews 
North York PD days 
Interim Report ' 



May 



Collect interview data ' 
Visit 'EIC's in Northeastern Region 
Visit sites of Educational Information 
Stations 



June 



July 



August 



September/October/ 
November 



Qecemb^r/ January/ 
Febriiaw 




Collect interview data ' 
Plan dissemination to summer session 

students (OISE/ facilities of education, 
Ministry of Education courses) 
Interim report 

Analysis of interview data 
Classroom presentations 

Articles for fall journals and newsletters 

: . "'■ . ' r \ 

Report on useir interviews % T 
Analysis of negotiation sessions 
Interim report , 

* . i - ■ - '■ 

Dissemination activities 
Analysis of negotiation sessions 
Interim report »v ^ 

Analysis of questionnaire data * 
Analysis of /dost- data ' . 

Recomm^n^ialJio^is. concerning future of EISQ 
Interim fe^ort (December) . * 
Finai Report (February) 
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Educational Information System for Ontario. 

The Ontario Institute for Studies In Education 
Room S218, 252 Bloor St. W., Toronto M5S IV6 
(416 r 923-6641 Ext. 487 



r 



Dear El SO User: 

• Y 

According to our records, you conducted a search of. the ERIC 1 
data base through the Educational Information System for Ontario (EISO) 
-during the- l ast -two -months, -or -so. — As-you .know,-thls~is~ -an- -experimental— 
servlce, and Is part of a research project aimed at learning more about 
the Information needs of Ontario educators, and how these needs can be met. 

Could we -impose upon you to complete the enclosed evaluation 
questionnaire and return it to us in the self -ad dressed and stamped 
envelops, which is also enclosed/ 

Let us assure you that all data will be held in strict con- 
fidence and used only for research purposes. ' . ^ 

The questionnaire should take no more than twenty minutes to 
complete. It just looks longer! 

Many thanks for your cooperation. 



Sincerely, 



' * ' . Stephen B. Lawto'n; Ethel Auster 

a Y - Principal Investigators a-.-.. ... 



■S. If you requested the search on behalf of another user, please pass \ 
this questionnaire on to the Individual concerned vf or compfetion. ..; 



V 



Educational Information System for Ontario* . 

The Ontario Institute for. Studies in Education 
Room S218, 252 Bloor St. W. , Toronto M5S 2V6 
(Ul6) 923-66U1 Ext. U87 



£>earcn no. 



Topic: 



1 I I I I L. 



EISO USER EVALUATION QUESTIONNAIRE 



6-35 



Name 



(Last) 



(First) 



(Middle) 



Address 



Phone Number 



IP YOU HAVE COMPLETED A PREVIOUS EVALUATION, PLEASE START AT ITEM 26 



Organization Characteristics 



36,37 



38,3$ 



1. Please indicate the type of organization or institution vith which you are 
primarily associated by placing a check (vO in the. appropriate' space helov. 



(01 ) p reschool 

(02 ) v p ublic board 

(03) ^separate boarct 

(OU ) p rivate school or board 
(05) CAAT 



(08) University . t 

(09) M inistry of Education 

(10) P rofessional Organization 

(11) ' G overnment (not Ministry of Ed.) 

(12) B usiness or Industry 



(06) ■ Faculty 6t Ed; or Teachers y College. (13) O ther: Please Specify 

(07) OISE: Dept. or Unit " '. : _ JiU - 1^ g 

( ) - = 1 ' i - 1 1 -v • 



2. " Heme of Organization^ 
Address ■ 



Phone Number- 

( ) : 





• Funded under contract vith the Ontario Ministry of Education T 



1*2,1*3 



J 

3. Is your organization located in 

(01) District or District Municipality 

(02) County or Regional Municipality 

(03) Metro Toronto 

(pip Ottawa 

(05) London 
• ..' ••<••••' '• ' . ' " • 

k. Is your organization located in the 
Northeastern Region (Region 3) of 
the Province of Ontario? 

(1) Yes (2) Not Sure V (3). No 



(06) H amilton 

(07) Windsor 

(08) [ Sudbury 

(09) Canada (outside Ontario) 

(10) O utside Canada 



Is the community your organization 
serves 

,(l) Mostly rural 

(2 ) Equally rural and urban 

(3) Mostly urban 



Professional Role 



V»,l»5 



6. 



50,51 



7. 



Please indicate your primary professional role or function by placing the 
number "1" in the appropriate space below. If you have more than one major 
role, please enter the number. "2" in the space corresponding to your second 
most important professional role, and a "3" in the third most important ^ 
(if applicable). Leave the remaining spaces blank. - , 

(01) Administration or Supervision (08)J_ Private Consultant 

(02) •■ Teaching • ( 09 )_Under graduate Student 

(03) Pupil Personnel Services (10 ) M.Ed. Student 

(0U) Research ~ . ... (ll)_Ed.D. Student 

(05) Field Development (12) M. A. Student 

(06) _Ministry Regional Office- . (l3)_^_Ph.D. Student 

(07) Library Services (lU)_J)ther : Lj 



How. many years have you been in. your 
current .position? 



(1) Ll ess than 

one year 

(2) . 1 year 

(3) 2 -years 



(k) 3 years 

(5) U to 6 

(6) 7 to 9 

(7) 10 or more 



8. 



Would you like to obtain a more 
senior position within your 
organization within the next, five 
/years? 

(1) Yes 

' (2) N ot sure 

(3) ' No ' ••'>", 
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2,53 



>U-59 
0-63 

5^,65 



66 
67 



68 



69;70 
71,72 

73.7 1 * 
75-,76 
77,78 

8-,9- 
12,13 



ERIC 



EISO User Evaluation 



(3) 



School Board Personnel T>le use ansver qu e stions 9 to 12. Others please p;o to 13 . 



9. • Please indicate the level of your 
primary professional position. 

(1) Element ary grades only 

(2) Secondary grades only 

(3) JBlementexy arid secondary 

(10 Central "board office , v 

(5) Other: ■ 



10. What is the mother tongue of the 

majority of students served by you? 

(1) E nglish 

(2) .F rench 

(3) Other: ] . 



11. Board enrolment 



12. School enrolment T . « 1 x. 



13. 



15. 



Have you ever "been an officer, of a 
professional organization? 

(1) Yes (2)_Ho - 

Have you -written any professional 
papers for publication or for 
presentation at conferences in the 
last five^ years? 

(1) Yes (2) No 



lU . Are you a member of any 

professional organization other 

those required "by provincial 
legislation? 

(1). Yes -v (2) Ho 

l6. Have you participated in' an 
educational research project 
'in the last five years? .. 

(l) Yes (2) No 



17,. 



18. 



Do you plan to undertake additional study toward a higher academic degree 
sometime vithin the next five years? ( 2 )_ N ot Sure (3)_No 

Please indicate •* (A) the amount of time per ^/^^^ J^^l^ ' ■ 
obtaining information from each of the sources listed belov, and (B) hov. . 
valuable the information gained from each source is to you. 

" . v (A) Approximate -Time Spent ' ~ 

(hours per week) 



(B) Value 



Source 



a. Colleagues. - 

■b . Prof J ournals , books 

c. Outside consultants 

d. Inside consultants 

e. Office files, reports 

f. Supervisors 

g. Prof, organizations 

h. Libraries 

i. Confer ences v 



0 


1/2 


' 1 


/ ■ 

s : 2^ 


3-6 


7+ 


, Lot 


Medium 


High 








j-i — . 




_l ; — 


f 1— 


jL 


• 


_t_ — - 


J- 


.1 


• 




_i — 

-i 




t - L. 


,t ■ — 




• • 


-2- 


J 




• 




_i ! - 


,.' «- 


■I.,— 
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• 


t , 




• 




_z 


1 


t j_ 
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• 




1 


f 


• 


1 


,* 

* * 


■ •" ' C 
f — 1 




.t_ 


f 


-i 


_L 


J " '. 


*- 


* 


• 




* 


.t 




« 


|, 


• 








• 






• 


_x _ 


-L. 


t 


* 

• 


_i_ — - 

* 


_l 


« 


t _ — ±^ 


J 




• 


f 


a 










t f- 
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(1) 


(2) 


(3) 




(5) 


(6) . 


(1) 


(2) 


(3) 
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Source 



(A) Approximate. Time Spent 
(hours per veek) 



(B) Value 



1/2 1 



3-6 T+ 



Low Medium High 



J. Prof. Dev. Days j_ 

ki Academic, prof. courseSj_ 

,i. Curric. guides, texts j_ 

m. ERIC materials j_ 

n. Ed. abstracts, indices j_ 

o. Other: 



(1) (2) (3). Ah) (5i (6) 



(1) -(2) (3) 



-19 > 



How often do you seek information for the following purposes? Frequency 

_ _ ._ _ Ne ver $5cane-__0ttei^Very 



Purpose 



a. To keep, abreast in the field 
u b. Assignments, term papers, and theses 
v. c. Preparing or updating bibliographies' 

d. Curriculum development 

e. Program improvement 

t. .Preparation of speeches, reports, articles 

g. Research and development projects 

h. ? Browsing 

"i. personnel- recruitment, or evaluation ' 
- J • /Policy development , . ^ 

/Other: 1 ; ; — 



•times 



bften^ 

















f 


f 






' «- 


,1 

J 


. .1 






t_ _ 


. i- 


* 


a 


• 




T. ■ 


t 


t 


t ■ ■ 


* 







»- 








> 






• 


» - 
























* 






• t 





T 


* 






* - 




■1 

J- — 1 








1 






• 


« 




— 4— 




JL 












t 












1 


■ » 


«- 









(1) (2) (3) (U) 



Educational Opinions 

Please indicate your opinion about the following statements. 

* ■ \ Opinion 



20. Most innovations in education 
today, \such as initial teaching 
" alphabet (i.t.a), electronic^ 
' calc\ilators in' classrooms and the 
credit system, are really worthwhile 
and help ijhildren to learn better. 



Agree 



Agree 
Somewhat 



Disagree Disagree Don't 



(1) 



(2) 



(3) 



(h) 



(5) 



EISO User Evaluation 



21. Colleagues often ask me for 

advice about their professional 
^ problems; 

-22. I: am one of, the fev people, in 
• my organization vho are con- 
tinually trying out new ideas 
in their yoric. 

23 .\ Most educational innovations / 
today cost more money than 
they are yorth. . . 

2k. Only local school people know 
vhat their educational problems 



Opinion 

Agree Disagree' Don't 

:ree . Somewhat disagree Somewhat Know 



4- 



and needs are; not -outside experts .j_ 
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"TO" 



7JT 



EISO Search Information 



25. How did you first learn, about 

the Educational Information - ~ 
^ System for^Ontario (EISO) and ■ v 
rl_ its services * (C^^ one only) 

(l T B rochure . or flyer *> 
(.2) . A rticle in prof, journal 

(5) Prof. Development Day 

(U) Classroom instruction 

(5) Colleagues 

(6) Ed. Information Consultant 

(7) L ibrary tour ■ - 

(8) Cannot recall '■ * 

(9) Other; ' *. V 

' £>/'' ' > V ' •"• . 

27'.' .Please indicate" in the 'table "below the number.- of articles , nicrofiche, and 
documents ordered as a result of this search from. EISO and ERIC Document 
Reproduction Service. (EDRS). 



ERIC 



,26. Did ah E^upational Information 
i ■ ' Consultant (EIC) trained by EISO 
' * . assist in developing your search 
request?' (Check one only) 

(1) No EIC consulted (went directly 

to search analyst) 

(2) OISE Field Centre JSIC 

(3) F aculty of Education EIC 

(U) Ministry of Education EIC 

.(g) CAAT EIC) - . 

(6) Not sure 

(7) Other: ... 



. *type of Order 



Ordered From 



EISO 



EDRS 



Journal article a. 
Microfiche a. 
Documents from microfiche 



jione b. n umber? 
jione b. n umber? 
Not available 



J$a& none 



Not available 
none * b « j » n umber? 

b. ; 



jnui^er? 



1S( 



v 



EI SO User Evaluation 



(6) 



28. 



30. 



Is a microfiche reader available 
in your organization? 

(l) No fiche. reader available 

X2) gprtablc fiche reader 

available for use at home 

( 3) Non-portable reader available 

D on't know 

How aruch did you learn about the 
Educational Information System for 
Ontario 'as a result of your ^search? 

(1) Nothing or very little 

(2) Some 

(3 ) A great deal - 



29. How muclr did you learn about the 

topic that was searched as a result 
of the search? 

(1) Nothing or very little 

(2) Some . 

(3) A great deal. 



How much additional Information do 
you still desire concerning the 
topic' that was searched? 

(1) N othing or very little , 

(2) Some 

(3) A great deal " 



32.- 



How helpful was the information provided as a result of your EISp search for 
each of the following activities; (if applicable).. 





a. 


Keeping abreast of the field 


61 




Completing' assignments, theses, etc. 


62 


c V 


Fjfepari'ng or updating a bibliography 


63 • 




Curriculum development 


6U 


e. 


Improving programs 


65 


f . 


Preparing a speech, article or Report 


66 




Undertaking- or completing .a research , 




or development project 


67 


h. 


Browsing 


- 68 


i. 


Recruiting and/or evaluating personnel 


69 


3. 


Developing policy, \ 


70 


k. 


Other: 



Not at all 


Somewhat Very; 


HA • 




■-" f 


j — v 


t _L 


"L_ 


-«- 


. /: 




j : 1- 


t • L 




■1 '. : — t- 






j *- 






J «- 


• * 




a — J- 


V 

ff _l_ 




« 






-t — L 


• « - -t- 






—S^ «— U 
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Satisfaction vith EISO Search 

Please indicate your deairee. of Satisfaction with each of the following aspects of 
thllducational lnformkfion System for Ontario. Feel free to comment xn the 
space, provided or on the back of the page. Satisfaction 

£ ■■ Low Medium High HA. 



33. Convenience of arrangements to obtain EISO searches 
Comment2_ ; , . ■ 



(1) (2) (3) (M 



9 

ERIC 



16 1 



ERIC 



3U. 



Helpfulness of search analyst or Educational 
Information Consultant . . > 



Comments : 



/ 



35. Length of bibliography. 
Comments : __ 



36/ Readability of microfiche copies, if applicable. 
Comments: ~ ' ~ ' 



37. Accuracy of publicity materials , EISO 
presentations \ etc. 

Comments : ; 



38. Comprehensiveness of publicity materials, EISO^ 
presentations, etc. m <' 



Comments: 



39. 



Adequacy of directions for submitting search 
requests to EISO. *' 



Comments: 



1*0. Adequacy of directions for ordering copies of 
materia" 



Comments - 



Hi. 



Time devoted to search interview with search 
analyst or Educational. Information Consultant. 

Comments : 



U2. Time taken to deliver the EISO bibliography; 
Comments: - , 



is?:: 



Satisfaction- 
Lov Medium .High '.EA 



6 



10 



11 



12 " 



5,l6 



EISO 



User Evaluation 



(8) 
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1*3. Time taken to deliver microfiche or paper copies 
ordered t^cm ElSO. , 



Satisfaction 
Low .Medium High 5A 

— : i~ — 



Comments i 



kk. Time token to deliver microfiche or. paper copies 
• ordered from EDRS in the United States , if 
applicable* ■ + ; ' 

Comments : 



i 



U$. Value of bibliogpiphy itself.. 



Comments:"; 



j — - 



k6. Value of materials located via EISO bibliography. 
Comments : .' ; - s * — 

* ; c - '. ^ 

\J. ' Availability' of microfiche r^ade^s/ 

Comments: * ■ ; ■ : — . 



S 3 

-I. 



(1)' .(2) (3V~ U): 



lt8. Before using EISO, how. helpful 
. did you expect it to "be? 

(1) Not very helpful 

(2) Somewhat helpful 

(3) Very helpful 

$0. Would you recommend use of * EISO 
to a colleague? 

(1) Yes 

(2) -P erhaps 

(3) No • .: 



Ua. Would, you use EISO again? 
(1) Yes 
v (2) P erhaps 
(3) No 



51. . Do you think EISO search services 
should he. offered on a permanent 

basis? (1) Yes '• 

(2) P erhaps 

(3) . .: . - 



Personal Data 



r*i8 



52. Age (l) 25 or under 

■". : (2) 26 - 35- 

. *N--( 3 r 36'- hi: ■ • 



ih). U6 - 55 

(5) ,:; % --65 

(6) S econd youth ^ , 



53.' Sex' : (1) .Male 
- f . * (2)_ Female 



E£SO User Evalxifittidn-> 



: ^ (9) - 



>i54 



TP- 



54i... Ho. of p>reTi6us EISO searches, 

' / if any. '? r K ' ■■^'P .. 

. f ■ (3) &io 

(5.) - 6 or more ^ ' 



55 • * - Highest ' earned degree 



1 ) - H igh school or less 

<2 > T eachers 1 college 

<3) B achelor 1 ^ m y .;y 

Of ) M aster's 

(5) -Doctorate 



-X: 



Many thanks for your assistance in completing this questionnaire, 'and -participate 
in-the EISO project* Please mail the completed questionnaire in the enclosed 
addressed and stamped envelope to: Educal^nai* Information System for Ontario, 
OISE Library, Room S218, 252^ Blopr Street West, Toronto, Ontario M5S 1V6. ... 



ALL DATA WILL REMAIN CONFIDENTIAL AND WILL BE USED ONLYPOR RESEARCH PURPOSES 



V 

i 



.4k 




ERJC 



I 



. ; V - 
■ ■ f ■ 



■ .--=•- ■ i .- ■• TTi— * ■- 
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Educational lafowaticn _SysteR for Ontario ^ 



V 



Search So* t t o t ' ; * eg. 

•I >i ■'.* • '•; 



Tdp:L<C2 



SISO SERVICE EVALJJATIOS DATA SHEET 



\ Search Request 
1. ' Rc l, d. j-t-i. 



2". IctW. T t * ' T " " f 

12 

. • •• .-W . 



? JP ""-1 T T f I » ' 

. ■ is - ■ ■ ! .';--'.' :; 



i - c c > ij ro7"> Research/developaent report 

24-25 A. Purpose (01)_Keep abreaat of field <07J__Keseax / *~ ! 

^^Asaigumeut, term paper, thesis (08)_Br««tag 
.... (03)_"j?rep., update of bibliography . 
' - (OA) Curriculum develops* t 
^ (05)_Program isproyencnt 

• ' (06)_^Prep. speech, article,' report : - ; ; , — 

5. ■■&*t~* CD-J* person ;(2>_Pho a e fV^j. pi*~? 

S. - • _.c . . . 8. feef. exp. * i • r , t 



26 



(09) _JPersbanel recruit, eval., sup, 

(10) __Policy development- . 
(llX^Oth eje^. - 



6. -Earliest yr. ro/d. ?• " »>, ref . rq'd. g T T -». . :, 33 

'•■ w ^- 2 Io Priced Pa7^»t <l)_Cash .C2)_Srvoics 

'"' 37 , ' . " v 

Charge fo r search . \. ■ — • • ' »/ 

42.L 12^ p»ys Cl>_EISa(£ree) <2)__2e^est OT r 



13° OISE * charge Unit . , ♦ "f Prbj , t t t t u 



-Line > » « t 



-Inv. no. « t 



49 



53 



61 



Search 



14. Incw., strat 



5 . 



. «*» . ■ ■ . nin. 1$'. . ^^ii^iM^W^ito-' ■•^J*^ 



tine . . t gain. .. i 8 « Clt. prmcea i t t t t • ?Q 



17.' : Connect 



: - * - -66 - . ■ 

7 ill^ ^^^j^str. Search Anl^t (3^IC ' (Aether, 



. 5 '.^ 



Card 5 ,'; , k ' ;•' 
21. Date bib. 'rc'd.. 



_T- T » * t f - 



22. Cos'tZhr system T - T t • t ■ ' : 



ERIC - 
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15,16 



M' 
45 



Materials Charge 



23. Payment: (l)l_Cash (2)_Invoice ; . 24. Who pays C^EISO (2)^R OOrg C4)_J 



Cth. 



19 23 



Inv» no. » . t > » y ■ 
27 



25. OISE. charge Unit , . , 

• " : . v ' ■ 17 '! 

Katerials ",•»* 

26. HEISO fiche ^^j! 27. N EISO arfcl t t t t 28. ftJBDRS pap doc 

32 - v ' : 35 • ' .• 38 . 

29. HEDRS fiche ^j^j, 30. EISO reader av'lbl <1)_JT (2)_U • (3)_DonVt know 

30. -Another rd'r. av'lbl (1)__Y " (2)__N (3)_l>pn , t know 

31. Price first search : ♦ f *' 



I 



■i 
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V : V ' • ■ 
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Computer Term! na 1 (Computer. Devices, Teleterm 1030, APL/ASCI !) V 

The 
data 



Fie computer term i Qa I i$. used by the search ana lyst access the ER I C- 
ata base. 1 : • .: ' " ,'./' — ■ • 



• Telephone i ' . - . ( , 

The telephone is the^ connecting I ink between the tenq^na J "end the computer. 

Fiche Printer 4 NB Rotary 404A) 1 Q , , : . ■ ' \ 

r r r-' T p — r ,. lo 0 7 *r\A \ i Be and Howe - 

Ft che^ Processor (NB Processor. 404) J. , - . : . ^ - \ 

The fiche % printer and processor produce dup I icate fiche. This twb step < 
process which uses heat and diazo technology take^ 

V fiche/' ' ' ~ * :. ■ 

Fiche Reader (Micro-Scan Systems, Escort K1 00) ; 

This portable microfiche reader is used to check the leg i hi I Tty of the 
dup I icate f iche produced^ '■>. * 1 

Type Recorder . r ' . t - V : _ :: "\ ' ": 1 • -\" ' " V. '-' " - • - ; - • "./'V:V- 

ThisU4 6 : to : record interviews with cl tents fbr future reference ancT ana lysis* : 




/ ^Cerox Machine: (Xerox 400Q) 
^Photocopies of journal articles are made for cl rents on the xerox odpier. 



Typewriter ( I BM Se I ect r i c ) 



9 

ERLC 



158 



APPENDIX F* Publications Used by thiff^fiducational 
r . Information System for Ontario 



Thesaurus of ERIC Descriptors (6th ed.) New York: Macmillan Information, 

r . .'. ' • - " * • - / ■ " — • * a. " 

- ^esc^urces/in. >Educat ion * Rational Institute for Education, Department oP 
'* > ^Healt^ Eaucaticjn >a^2T Welfare, Washington, D.C.: Superintendent of 
ADocunue^ Government Printing .©fffce, 1966 . ; r-. 

Current ^Ihdex to /Journals in Education , National" Institute for Education, 
: Department of-Heal€E, Ed*icatioxv» and; Welfare , Washington, D . C. t . r o 

: , U.S. Government Printing Office, 1969 - 

EISO User y s Manual , Educational information System for Ontario , 

Toronto: The Ontario Institute for Studies in. Education, -1975* * , V". 
Unpublished" manuscript. \ . 



■ i 
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/ \-Y APPENDIX G.. Educational Information Stations 



r 



. The purpose of the Educational. Information Stat I ons ^toprovTde 
the user with information concerning how to make- use of the Educational . 
Information System .for Ontario,, to supply himwith search request and order 
formsTand to give him access to a microf iche reader. These stat ons are 
norma iyinstailed in the resource centre, staff, room, or profesjlpnar 
library of a school , board, or. regional off ice. The equipment and materials, 
that compri se such a -stat ion v i ndtfudee % 

.1. (Portable microfiche reader' with instructions for use. 
V>- } / 2, Microfiche filing box with capacity for 1000 fi Che. ; - . 

, ' .-' 3. (loose-leaf brhder contaTning 3 : > 
... : :~ ■ \ ■ .a) Information jt Iyer descri bi ng the service ' . - ^ 

. - ; . ': jb)„ Search request forms . x 

- . ■/* c ) ' Samp I e output b i trl lograph ies ."v. 
; "[ : | O str^c±jons. for inter 

e-J'""- ^Dbcuraen1^--OF-dej?- 'forms - *•' - '.s: ' 

f ) cSamp te journal-, arti cles : and i.che'. ' 
g) El SO staff I ist and; local EIC / . ~ " 

4. Extra ' l i ght- b\jlb : for -fiche reader . . _ ■ , : \ 

.' As a result of a survey taken ; last summer ^ i t was revealed that 
few el emenJar^ schools i n the Region 3 target area of the El SO project had 
^rSf t^f Sders!^ tn order to~ adequately test the." acceptibiMty and use of 
!2S" ST+hil area rt was felt that such readers should be. installed 

Ithe Regional Office of the Ministry pf Education. As-a re ? u, T^™.^on 
/or^ation of the Nipissing District 

/stations at three elementary schools in his jurisdiction: St . V . ncenT o e 
Paui.and It. Hubert .School In North Bay.' and- Echo. Je«?^i^rgjw^.J|s 



Si itaolaL Of f Tee or the Mi n istry of Education. As* a resu It; the Director. 

atlons'at three elementary schools in his jurisd ct.on: St. V ncent de 
,ul and St. Hubert -School in North Bay . and Echo 
A Professional Development session describing the project e^d.^r^^rv ^ 
was held at each location. 

and last of these are French language schools. 

Other Educational Information Stations were also installed in the 
cen+ra j offices of the East Parry Sound Board of Education, the Muskoka A 
Board of Education, the OISE Northeastern Field Centre, the Regional Office 
of the Ministry, and the Library of Canadore Col I ege/Ni pissing Faculty of 
Education.' . .- . /. *5 
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(Northeastern Re£idnt 



I 



Front 



EDUCATIONAL INFORMATION SYSTEM FOR ONTARIO 



;ISO Search Analyst 
>ISE Library 
252 Bloor Street West 
Toronto, Ontario M5S 1V6 

(416) 923-6641 Ext 487 



I ■ 
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Have You Heard About E ISO? 

Chances are you face problems now wh^ere additional 
information would be of help. If so, ftfe Educational 
. Information System .for On tario (EISO) project is 
. ready ' to assist b? locating and duplicating^naterials . 
contained in thp collection of the Educational 
: . Resources Information Center {ERIC). 

What Is ERIC? 

ERIC is an information gathering arid disseminating 
network comprised of 16 subject-specialised' '/ 
\ : ■ clearinghouses operating under the auspices of the 
V U*S. National Institute for Education. The clearing-. 
r housescdtect^ Index and abstract research reports, • 
/ Conference papers, curriculum materials and hand- 
-books, including many from ^Canadian sources, and 
-announce them 'monthly in- Resources in Education ': ' 
. (/?/£}*. They also index more than 700 journals, 
. . including 26 from Canada, for the Current Index to • 

Journals in Eduction \CJjE). In all,the ERIC data 
.... . base includes over 200,000 references, to wfridlv;- jif 
almost 2,500 new references are added each rriohthl" 

How Can EISO Help? 

By searching the ERIC data base for information on 
a particular problem or area of interest, you can learn 
how others have approached the issue. EISO provides 
direct access to ERIC, retrieving references quickly 
and inexpensively. The service will be of particular 

: ' help to those working under the pressure of deadlines. 

^ For public addresses and research reports EISO will 
^rove helpful; for planning and decision-making it- . , 
may prove indispensible, 

Ho# Does EISO Work? 

A search request is submitted to the search analyst^ a 
specially trained reference librarian in the OISE 
Library, who rewords the content to conform to a 
list of subject headings designed fofcomputer 
scanning of tfc^e ERIC data base. Via a computer 
terminal, the search analyst queries thre data base * 1 
which, is stored in a computer operated by the System 
Development Corpoo£ti<?n of Santa Monica, 
California. When combinations of subject headings 
are entered (e.g., business mathematics AND 
.secondary school) , the number of relevant citations 

.. and sample citations are printed x>rvline. If the 
citations are appropriate,Lthe complete set of 
refere n ces .an d abstracts are p ri n te d of f -I ine in Santa * ■ 

. .Monica and mailed directly to the/equestoh -v- 



How Long Does a Search Take? 

The computer search itself normalIy r takes fifteen 
minutes, but follows a. half-hour ? s discussion with, the 
search analyst whenever possible. The* bibfiograpf^ 
usually arrives within a week of receipt of a. search . 
- request, ■ ■ - : .■ ' \'. • 

How Much Does a Search Cost? ; 

The current charge r for a complete literature search; • 
^including consultatipn and printed bibliography; is\- 
x ^ 00 in the Northeastern Region (Region 3K \ 




How Do 
Documents a: 



Articles? 



Documents are* available^e^i microfiche fr^ EISO at 
.a charge of.35.tf per fjch^^whlk paper copies, are y 
available from the E^ ^ 
.Service (EDRSjlin the United. State^^aper copies of : 
journal articles are available from ElSO^a^a. charge of 
1 04 per page. Order fbrmribr*bolh.d6cuiyifeqte and 
articles wii I b'esent to clients after.their search^ have^ 
.been completed. •.' - r ■ ? 

How Do I Request a Search? 

Complete the E(SO Search Rsqaest Form on the.oye^ 
leaf and mail it to the address below; phone the . ; 
search analyst directly; or make anappointment with 
the search analyst at the .EISO Search Service Office . 
located in the OISE Library on the second floor of 
the OJSE building. • !" '.. ■/;:/ 

EISO Search Analyst 

OISE Library . ' 

252 Bloor Street West ✓ . * ; ■ ■■ 

Toronto, Ontario M5S 1V6 ,V ■ r ; - 

(416) 923-664 : I Ext. 487 : - V v ' - 

How Can Clients Assist EISO? 

Though EJSO provides what is expected tol>e a useful 
•service, it is also a research project looking into the 
information needs of Ontario's educators. It will be 
greatly appreciated if clients complete-evaluation 
questionnaires or agree to be interviewed, if asked to 
do so. ; . • •- ; ; 



♦Project funded under con tract" with the. Ontario. Minis try of Education: 
S. Lawton and.E. Auster^rincipaljrivestigatocs^* .': . * \ 
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1) Name: 



Address:— 



Phone: 



( ) 
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2) Invoice (if payment ismot enclosed): 



JL 



3) Search Topic: Grade level(s) 
\ -Detailed description of topic — — ^ 



. Year(s) to be searched - 



:o be s^wne 



r" 



4) Reasons for requesting seaich (Please be specific, giving examples of how you hope tb use the information) - 



5) Maximum number of references you think possible 



6) Actual number of references desired for use 



if natations for relevant materials known to you , tf any 

% — — '— ...... 1 ~7 ~ - v.. - ■ : ■ * 



Authors writing in the area, other than those cited above -—^ 



>; 



"Please mail Completed search application to 

>vElSO Search Analyst 
/ r., OISE Library ^ L ' ^ v 
252 BToorStreetWest ~ 
Toronto, Ontario M5S1V6 



— 3~7^ 
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GROUPS TO WHOM COPIES OF THE BROCHURE WERE DISTRIBUTED 
~ ! : ' — ' 



I . A! I Schoo I BoaifcJs 

2. Universities / 

3. CommunT+v^Col leges 

4 . . Facu It? es of Ed uca+ 1 on 

5 • /.Teachers Col leges 

• ■ - 

6. * "Libraries' 



7. Regional Off Ices of +he #f nis+ry/of Educatio 

8. Ot'SE Field Centres' ( '"' • 

9. Private Schools 
10- Indian Schools 

11. r Professional Organizations 

12. Tenants of 0!SE Building 
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ASK ERIC... 



Chances are ytm fact «w. prob- 
lems now where addWonal infor- 
mation would be of help; perhaps 
you ^wonder bow otters nave ap- - 
proached a certain issue. A geog- 
runny teacher In an Ontario ele- 
mentary school may need guide- • 
Ones for the teaching of geography 
through, the use of computers;^ 
administrators may wish to learn 
what use has been made of trf- 
mestering in elementary schools* 
Educators throughout Ontario win 
be Interested In- a new Information 
service Being provided through the \ 
Library of the Ontario Institute. 

* for Studies in Education. The serv- \ 

• ice is* one aspect of the Educa-3 
tionaJ Information. System* for" On- \ 
tario (EISO) project at OISE being > 
funded under contract by the. Mm- 
istry. of Education. Its purpose is. 
threefold:^) to r v prawide -^sdradK 
post-secofjdary -institutions, . 'etc".* 
with several alternative answers to 
their* questions- from which they 
can choose; 2) to enable educators 

to learn from the experience of 
others in the approach and solu- 
tion to PJsSfSJ* 5 ° r tasks that are 
similar* tcSlBetrs,* or in the intror > 
duction and implementation of in- 
novative programs in a related 

. area;, 3). to furhish information j 
about the most recent* . up-to-date ** ; 
educational practices ^ind* research. 

An individual interested in i^gg 
the service, which has been in full 
operation since September f. 1975, 

. simply describes the. topic- of inter- * 
est and explains the reasons for re- * 
questing the information, so that * 
appropriate typc^of materials can 
be located. For>«ample, the. 
teacher who needs guidelines for ; , 
the computer-assisted -teaching of r 

. geography* w o u 1 d " forward ^Jthe.', 'n 
request -'by phone or letter to the 
search analyst,- a specially trained: . 

.reference librarians Special search^ 
request forms are also available for 
this purpose. 

ERiC : ^ > 



Upon receipt of a -request, the 
*- search analyst rewords the" content -~ 
in terms of a list of subject head- 

* ings designed for. computer scan- 
ning of .a large data base for rele- / 

\ vant materials. The data base itself " 
is maintained by the Educational" \. 
Resources Information CenleT; 
(ERIC), an information gathering, 
and dissemination, network oper-^ 
ating una^the auspices of the 
United States^ National Institute 
.for Education, rhrough the Cur- 
rent Index to Journals in Educa- 
tion (CUE) and Resources in Edu- 
cation (RIE), ERIC has indexed * 1 

^over 200~QQO items* including cur- ; 

- • riculuni n^erials, journal articles,, 
/conference papers, research re* ■ 

ports, etc. Substantial amounts or . : 
'Canadian -materials are included, in 
-* xhc -ERIC data base, helping to 
make it one of. the most\aluabIe 

- sources of information for educa- 
\ .tors. * \ ' : 

-* The -search analyst then con- 
ducts the search via a- computer 
terminal connected tor a computer " 
operated by the System Envelop- 
ment Corporation of Santa * lflon- 
ica, California,, where^ the £RIC 

- data base is stored. On typing the • 
various subject headings into "the 

. terminal, the search analyst learns 
_ exactly how many relevant docii- 

- rnents* are contained in the collec- 
. tion: There might »be well over 500^ 

items listed binder "geography in- • 

structfon" — byt as the terms 
a . "computer-assisted^ instruction" and 
. ^elementary schools" are 
"J added, the items that would be . 
' classified under all' three headings 

might be limited to 11. To com- 

plete the search process, the search 
/analyst \ instructs the "computer to* 
. ! print a^bibiiography. 'containing the ^ 
'relevant . citations, which 'includes 

abstracts for tfocuinente..mdexed -in 
: RIE* The biolipgraphy fc. mailed 
4 directly 'to the, requestor, where '* it 

will normally arrive within °ne 

week. - '" . " 1 



For this search service, a fee of 
$30 per search is being charged to 
a coyer computing and mailing 
/ costs. Users may pay in advance; 
/ or choose to be mvoicecL 

To assure access to complete 
documents and articles appearing - 
in EISO bibliographies, the infor- 
mation service is also providing, 
copying services. After reviewing 
the bibliography, the person re- 
questing a search may wish to or- 
der copies of several .complete 
documents. Taper copies are pro-, 
vided for journal articles at 10c 
per page, and microfiche ^repro- 
ductions (3 by 5 inch "negatives** 
that contain, images of up to 96 
pages) are provide for reports at' 
35c perfiche. .;- 

Individuals interested in request- 
ing a search should contact Ms. 
Elizabeth Reicker, Search Analyst, 
EISO Search Service, OISE Li- 
brary, 252 Bloor Street West, To- 
Vronto, M5S 1V6, or Phone (416) 
923-6641 ? ^xL 487^ . 

In-deifSth search related to the 
provision of local Educational In- 
formation Consu^ants (EICsJ to 
assist in requesting and inter- 
preting educational" * information 
will be conducted u in ^^^^ojtor.. 
eastern Region. Educators in^SHis 
region are advised to contact 0 
their director's office (or Regional • 
% Office in the ..case : of ijsolated 
boards) to learn^proper prck»dur^- 
for 'placing search, requesfe" wim 
their Educational Information 
■ Consultant. Through its North- 
eastern Centre locajRf^teiNofth 
Bay, tb* OISE Of fi^ of Field De- 
velopment is partiCTUarl^ active,. in 
this phase ofith^jtmiy.. " V 
':. The - princif^f investigators for 
" tEfe project, Mrs. Ethel. Auster and . 
• Dr. Stephen I^wton-pf* thd;*:l?fer % 
.partmetit ."ol ^ Educational Adminis- 
trationj OISpi>will be pleased to' 
p r.o-v-i d e.; additional information; v; 
concerning: ElSCy 'They jnay be . 
contacted at (416) 923-6641 Ext; 
420 iand Ext. 654, .respectively. • j 

' : : • - . , 13' 
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EDUCATIONAL INFORMATION SYSTEM FOR ONTARIO 

El SO Search Analyst / 

OISE Library - . * ~ 

252 Bloor Street West . # . - - • 

Toronto, Ontario M5S 1V6 ^ 
(416) 923-6641 Ext 487 ^ 

1) Name: , ■— ■ : — i — — 



2) Invoice (if payment is not enclosed): 



Address: , 



Rhone: ( 



3) Search Topic: „-Gfede level(s) 
Detailed description of topic . 



-Yeatfs) to be searched 

^_ -t^ v_ 



4) Reasons fSP* requesting search (please be specific, giving examples of how you hope to use 
the information): . 



5) Maximurru-mimber of references you think possible: 



6) Actual number of reference desired for use: 



r 



7f 



pitatiorisjfor relevar^nriaterlals known to yoi^if any:-^L- 



8) Authors writing in. the area, . 'other than those cited gbove: _ 



• - 



Please mail completed search application to 

EISO Search Analyst ' -\' x 

OISE Library ^ ■ . 

252 Bloor Street West 
~?Sra{it6 f Ontario M5S 1V6 
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NEW 



INFORMATION 



SERVICE 



FOR 



EDUCATORS 



.. 7. 



: Trustees, administrators, teachers'and 
other educators, will be interested in a 
■\ .new; .information service being pro- 
Aided through the Library of the* 
. Ontario Institute forikudiesJEn Educa-. 
- t tiiato> The- ^sfinace, which locates :2nd 
* duplicates ^articles and reports^on vari- 
ous educationaotopics in ''response to„ 

;ERJC yr^ v 



requests from educators, is one' aspect 
' of -"the ^Educational^ Information Sys- 
tem for' Ontario <EISO) project 'at 
OISE being funded under contract by 
the Ministry of Education. 

An individual interested in using the 
service, which has' been in full opera- 
tion since. September 1, 1975, simply 
describes the topic of -interest and, 
explains the reasons for requesting the * 
information, so that appropriate types 
of materials can - be, 'located. For 
example, a board administrator might 
be interested in the use of paid. teacher 
assistants in elementary schools in 
order to develop a personnel policy for 
this type of position.- He would for- 
ward his request byphone or letter to 
.the search analyst, a ^specially trained ♦ 
reference librarian. Special search 
request forms are also available for this 
purpose. 

Upon receipt of * a request, the 
search analyst rewords it in terms of a 
list of subject headings designed for 
locating materials contained in a large 
data base that will be searched by 
computer in order to locate relevant 
materials. The data base itself is main- 
tained, by the Educational Resources 
Information -Center (ERIC), an infor- 
mation gathering and dissemination 
nertvork operating under the auspices 
of 'the* United* States" National Insti- 
tute for Education. Through the Cur- 
rent Index to Journals in Education 
(dfJE ) <and Resources in Education 
(RIEh ERIC has indexed over 200.000 
items, including curriculum materials/ 
journal articles, conference papers: re- 
search reports, . etc. Substantial 
amounts, of Canadian materials-.. are 
included in the ERIC data base, help- 
ing to make it one of the most valu- 
able sources of information for educa- 
tors. ' - ■ I' 

The search analyst then" conducts 
* the search via a* computer terminal 
connected to a computer operated by 
the System Development Corporation 
of Santa .^lbnica N CaIifbmia , , where the 
ERIC 3ata b^se is stored. On typing 
the. various subject headings into, the 
terminal, the search analyst learns 
exactly how many relevant documents 
are contained in the collection! There 
jrijght be" over 500 ite.ms listed under 
"'teacher .assistants** — ,but combining 
the ,ter"m a \v1th^*ele;mentary school"' 
and v,*persbnner policy"* -might reyeaL 
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only I S items classified under all thrre 
headings. To complete the search pr-:-- 
cess, the search- analyst instructs the 
computer to prints bibliography con- 
taining the relevant* citations which ' 
includes abstracts . for documents ir* 
' dfexed in RIE. The .bibliography' is' 
mailed directly to the requestor. where: 
it will normally arrive within one. 
week. . 

For this search service, a fee of S50 
-per search is being charged' to cover ^ 
computing " and mailing' costs. Users * 
may pay in* advance, -or choose* to be .[ 
invoiced. ' ' " ' . - 

Tb assure access to ^complete docu- * 
ments and articles appearing in, EISO 
bibliographies, the* information ^rvic* 
is also providing -copying services- 
After reviewing the bibliography, the. 
person requesting a search may wish to 
order copies of several complete docu- 
ments. Paper.' copies are provided for 
journal articles at IQ4 per page." anf 
microfiche reproductions (3x5 inch 
**negatives** that contain images of ur 
to 96 pages) are provided for reports 
at 35^ per fiche. 

Individuals interested in requesting 
a search should contact Ms; Elizabeth 
Reicker, Search Analyst, EISO Search 
Service; OISE* Library,. 252 Blopr 
^Street West, Toronto,. M5S lV6_cc~ 
phone (41 6) 92^6641 , Ext. 487. 

In-depth research related to the pre- 
vision of local Educational Informs 
tion Consultants * (ElCs) to assist in 
requesting and interpreting educa- 
tional in foiination 'will be conducted 
in the Northeastern Region. Educators 
in this region are advised to contact 
their directors office (or Regional 
Office in the case of isolate hoards) to 
learn proper procedure^ for 'placing 
search requests with their Educational 
Information Consultant. Through its- 
Northeastern Centre located in Noi^ri 
Bay, -the OISE Office of Field Devel- 
opment is - particularly 'active* in this 
phase of the studv. ' 

The principal investigators, tht the 
project, Mrs. Ethel Auster and -Dr-/ 
Stephen liawtoh of .the Department of 
Educational* Administration. OrSE.; 
will be. pleased to provide additionai" 
information concerning ElSO^jhiy . 
may be contacted at (416) 923-66-i.l." 
Ext. 420 and Ext. 654 r respectively. 'V 

: . • \ "; 27.' 



J_ Chances are yon face new prob- 
lem* -now where additional inform, 
■nation would be of help; perhaps 
.yon wonder how otbe» jitvc ap- 
proached a certain issue. A geog- 
raphy teacher tn an Ontario' sec- 
ondary school ftnay need guidelines 
for (be teaching of geography 
through the nee of comp ut er s; ad- 
minfatratucs may wfch to learn 
what use Its* been made^ of tri- 
mestering In secondary schools. 
Educators throu ghout Ontario win 
he interested in a new,inf ormaiion 
service being provided t farong h the' 
^brary of the Ontario Institute 
forStudk* in Education. The aery- 
ice is. one aspect of the" Educa- 
tional Information System for On- 
tario (EISO) project at OISE being 
funded under contract by the Min- 
istry of Education. Its purpose is v 
threefold: .!"> to provide schools, 
*■ post-secondary * institutions* etc*, 
with several alternative answers to 
„ tbdNk questions from which they - 
can choose; 2) to enable educators ; 
to learn from the experience of 
others, in the approach and solu- 
tion to problems or tasks that are ■ 
similar to theirs, or in the 'intro- 
duction and implementation of in- 
novative programs, in a related 
area; 3) to furnish .information " 
about the- most recent, up-to-date 
educational practices and research. 

An individual interested in using 
the" service, which has been hi full . 
: operation since September I, 1975,' 
simply describes the topic of inter- 
est and explains the" reasons for rtj 
questing the information, so that 
appropriate types of materials can J 
be located For example^, the 
teacher who needs ^guidelines; for 
the computer-assisted teaching of 
geography would forward the 
^?qucst^y phone oKletter to the 
Search analyst, * a Specially trained ' 
reference librarian. Special search * 
request .forms are also* available for 



^ Upon receipt of a request, -the-- - 

^search analyst rewords the content 
.in terms' of a list of subject head-_ 
- ings: designed" for computer scan- 
ning of a -large data base for rele- 
vant materials. The data base itself 
is maintained by the Educational 
. Resources " Information^ Center 
(ERIC), an information gathering 
and dissemination networjc .oper- 
ating .under the auspices of the . 
United States' National Institute '/ 
for Education/ Through, the Cur- \ 
. rent Index to Journals in Educa- 
tion (CUE) and Resources in .Edu- 
cation (RIE), ERIC has -indexed 
'over 200,000 items, including cur- 
riculum materials, journal articles, 
conference papers, research re- 
ports,, etc. Substantial amounts ojf 
Canadian materials are included in 
the ERIC data b&e, helping, to 
^ make it one of tiT^most Valuable 
sources" of m information fpr educa- 
tors. ' " -~^\ 
fc . The searchf analyst^faen con- r : 
ducts the search via a gmpu ter 
germinal connected to a "con 
operated* by** the ' System De 
merit Corporation of Santa MqqY 
„ ica, California, where the " ERiC 
data base is stored. On typing the 
various subject headings ^Jnto the 
terminal, the^search analyst learns 
exactly hpw many relevant docu- 
ments are contained in the -coJlec-* 
tion. There might be well over -500 
items listed under "geography in- 
struction" — 'but as the' terms 
"computer^assisted instruction** 
and^ ''secondary- schools" are - 
added, the .items that would be 
classified under all three headings 
might be limited to 11; To com- 
plete* the search process, the search 
analyst ^ instructs. theU computer to 
print -a bibliography containing the 
relevant citations, which includes 
abstracts for documents indexed in 
RIE, The: -bibliography is mailed 
directly to'" the requestor, where it 
will . normally arrive within- one 
week. * — 



Oct- f 75, 226-227 



1*7.8 



^Fbr this 1 search service^ a fee of 
$30 per searcjx is being charged to 
cover computing and mailing 
costs. JCJsers may pay in advance, 
or choose to be invoiced." 
. To. assdre access to complete 
documents; and articles appearing 
in EISO bibliographies, the infor- 
mation service- is also . ;provicfmg . 
copying services. After ' reviewing 
tfjfc bibliography, the person* re- 
questing a search' may wish to or- 
der, cjyf> i e s of several complete 
documents. Paper copies^are pro- 
vidjw for journal articles at 10c 
page, and microfiche repro- 
ductions (3 by 5 inch "negatives" 
that" contain images of up to 96 
pades) are provided for reports at 
35^per fiche. 

Individuals interested in request- 
ing a search should contact Ms, 
Elizabeth Reicker, Search Analyst, 
EISO Search Service, OISE Li- 
brary, 252 Bloor Street West^ To- . 
ronto, M5S lV6,*or Phone (416) 
923-664* Ext ^487. 

In-depth "search related to the" 
provision of local Educational In- 
formation Consultants : (EICs) to 
assist iij. requesting and • inter- 
preting educational information* ? 
will be conducted in the North- 
eastern Region/ Educators in this 
region are advised to contact 
^eii; director's office (of Regional 
Office in. th6 case of isolate 
, boards) to learn proper procedures , 
for placing searc^Tequests with 
their Educational 4 Information 
Consultant Through its Norths 
eastern. Centre located in North 
Bay, the OISE Officeof Field De- 
velopment is particularly active in 
this phase of the study* 

The principal investigators for 
"the pfojectf Mrs. Ethel Auster and 
Dr. ^Stephen Lawton of" the* De- 
partment of Educational Adminis- 
tration, OISE, will be pleased "to 
provide additional information*, 
concerning EISO. They may be 
contacted at (416) 923-6641 Ext 
420 and Ext. 6&, respectively. . ^ 

' ' ' , . ': • 227 * 
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Information 




Perhaps you areriot satisfied with the 
rdfding program you're using or want to 
try a different markihg^ystem. Perhaps 
you are a member oT a curriculum com- 
mittee trying to develop materials on a 
new subject.— ecology, economics, or 

whatever. Or perhaps you are on a 
negotiating team and feel you need new 
approaches in order tohasten a'satis- 
factory settlement In each of these cases, 
there is a need" for Information. Others 
have faced*lmilar*problems, and chances 
are there are reports, articles,- papers, or 
guides available on the topic at hand that 
would provide you with fresh ideas, 
insights, and even, on occasion, specific 
solutions. Unfortunately, finding relevant 
materials is a serious problem in itself. 
Few practicing educators have time to 
visit a libraiy to search for materials; and 
even if they do obtain some references, 
obtaining the documents themselves is 
usually impractical or impossible. 

It is hoped that a new information 
service being provided through the 
Library of the Ontario Institute for Studies 
In Education will help to reduce this 
Information bottleneck by jnaking ft easy 
both to locate and to obtain educational 
literature/ The service, which locate? and 
duplicates articles aod reports on various 
topics In respohserto requests from 
educators, is one aspect of the Educa- 
tional Information System for Ontario 
(EISO) project at'OISE beirifc funded 
under contract by the Ministry of 
Education. \ 

The service ts 3 bc^en in full operation 

' since Septefnbetl . 1 975. An individual* - 
interested infusing it simply describe the 
'topic of interest and explains how the / 

. information is to be used. For example. 
' a teacher might be interested in reading 
materials for grade.l children in rural 
areas in orcterto develop: a more relevant 

* and stimulating program.' She would 
forward her i^estb^ohone or tetter to , 
the search afelyst, a sp&eiaily trained 
reference librarian. Special i 
request forms pre also available for that 
purpose. * ; . -s^ 

ERJC^ o j ? "' 




Upon receipt of a request the search 
analyst rewords the content to conform 
to a list of subject headings designed for 
computer scanning of a large data base . 
for relevant materials. The data base Itself 
is maintained by the Educational 
.Resources Information Center (ERlC)„an 
information gathering anddissemination 
network operating under the auspices of 
the United States ^ationaMnStitute fqr^.v 
Education. Through the Carrent Ind6xi6 : * 



Journals fo Education 0 
Resources in Educate 
indexed over 200,000i 
journal articles, curric? 
conference papers, an 
Substantial amounts of 
rials included, in the ERIC 
to make it one of jthe most 
sources of information 



id . . 

has. 
^iding 
Itarials, 1 
rch reports, 
iianmate- 
rbase help • 
iliiable* ; 
Educators. 



The search analyst then-use^ a com- * 
» puter terminal connected taa Gdmputer 
operated by4^§ystem Development 
f Corporation b1*Santa Monica, California, 
: wh^re ^e^C data base is stored. As 
y eachdtther^ 

^:"typ^ jlftoibkteirninarjjgie ninpber of * 
relewitdocuments is narrowed down. . 
. For examplet. there migffrt be over 50o 
items listed under 'reading materials,' but 
as the headings 'grade 1 'and 'nJral 
schools* are-added, the items that would 
* be clarified under all ihr&e headings 
^might be limited to 35,. To complete the^/ 
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process, the search analyst instructs the 
cbmputerto print a bibliography con- 
taining the relevant citations (which 
includes abstracts for documenfsJn RIE) 
The bibliography is mailed directly to the fc 
requestor, where it normally arrives within 

"e week* ^ — 

; For this search service, aieeof $30,per 

^arihJs being charged to <a>ver com- - 
. putir^ and.mailirigj»sts. Users can pay 

Inadvmc^beiijvolced. ^ 
* TO assure access to complete docu- 
; > ments and articles appearing la aSO ^ 

bibliographies, the information services 
*abo r prwiding copying services. After 

rlfoetfhg the bibliography, the person ... 

who requested the search may wish to 

orderbopies of several complete docu- 
s ments. Paper copies are provided for 
( JpurngJ articles at \0t per plage, and 

microfiche repcoductiohs {S^by 5* 

- Negatives* that contain images of up to 
96 pages) are provjded for reports at 
35* per-flche. ■*-•*" 

^individuals interested In requesting a' . ; 
-^arch should contact Elizabeth Reicker, 

Sfiarch Analyst, EISO Search Service. 
; .OISE Library. 25£feloor Street West, 
'Toronto. M5S"IV6,5r phone x 
(416) 923 6641 ,ext 487. ^ 

- In-depth research is being carried out s 
. in the Northeastern region of Qntariojo ' 

determine the value of having Educational 

/ Information Consul^hte In each region. 
Educators in the Nor^eastenrregion are-: 
advised to contact their'diieetors (or 
Regional Office, in ^leira^e of isolated 

v boaids)toleai^rbperp>oc»duresfor - 
' placing searchroquests witfi their Educa-- ^ 
tional Information Consultant Through its 
Northeastern Centre located in North Bay, 
the OiSE'Office of Field Development is , 
particulartyacAfoeinthisph^ 

' study. . : „ v •'■>••.-. 

' * The pflfietpal investigators for the 
~ptoject; Ethel AuSter and Dr. Stephen - *: 
■ "Lawton (Department of Educational 

' Administration), wilf be pleased to provide 
additional informatioaconcisming BSO.^ 
They may be contacted at (416) 923 6641 , 
ext. 42b and ext 65^ respectively- V 
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Literature searches^expedited 
by new computerized service 




r Dr. Bob Stinson, head of the Western Ontario 
. analyst Elizabeth Reicker. 

... The teacher developing curriculum,materials; 
the principal ^ setting objectives for his 
school* the 'director of education planning 
.. .experimental programs, the graduate student 
^working to a deadline on a course paper - 
all can profit by reading research reports and 
learning J afc>put other people's experiences. 
. A way to help them do so quickly and 
effectively is .being offered by a new project 
-housed in the Institute's Library. 
■ ■ .The .project, the Educational Information 

* System for Ontario (EISO), is a search serv- 
ice providing-computerized bibliographies to 
filt specific- information needs. The service 

.- has been in full operation since September. 2 
following a successful trialT>eriod last sum- 
mer y 

JBr/ Steve Lawtoh, "Department of Edu- 
cational Administration, and Ethel Auster, 
'.an OISE doctoral student on leave, from the 
f m Library/ are heading the project. Elizabeth 
Reicker is the search analyst, and Ann. 
Yeung is her assistant. J utta Keviwerth is the 

research officer. - • 

■ - - <r . 

Funded by MinistTy-of Education * . 
* 1 he project, funded by a Ministry of Edu- 

• cation contract, alms to increase the access- 
;% ibility of educational literature to Ontario} 

educators Ify providing computerized search- 
es of the Educational Resources Information 
Centre (ERIC) data base! V*. * * 

«38iF is an information%athering and dis- 
^rmnation network of 16. clearinghouses 



Centre, -dba.*! a ^«^ with search 



operating undei 



e 

ERIC 



the U.S. National Institute 
for Education. y"bey "collect, index, and I ab- 
■ stract research', reports^ conference papers, 
„■ curriculum materials and - handbooks, in- 
cluding many from Canadian sources,* and 
attSounce them monthly in Resources in 
£&bcatfon (RlEi They also index more than 
700 journals, including 26 from Canada, in 
Current !n&x' to Journals- in Education 

(aw ^ *~ 

In all, the ERIC 'database includes over 
200,000 references and is brought up-to-date 
monthly. ■ 

. The Institute Library* already has an ex- 
tensive collection of journals to provide the 
back-up material to Cf/E and has. the cdm- 
* pkte ERIC document cqilection on micro- 
fiche. 

The EISO service t^vidfc on-line (com- 
puterized) access to this great store of infor- 
mation. It is expected to help especially 
those working under the pressure of dead- 
lines — on course papers, drsseftations, re- 
search reports, and conference presentations 
— and those educators responsible, for 
^planning' and decision-making. 

Here's h ojg jhe system works. When^a re- 
quest is submitted to the search analyst, Njs. 
Reicker assists the cjien t to frame questions 
in precise terms chosen from ihtXhesaurus 
of £R1C Descriptors. She then types the re- 
quest into a^computer. terminal connected to 
the ERI,C data base in the" SDClcomputcr in 
Santa Monica, California. The computer res- 



.80 



ponds almost immediately by printing out 
the number of references indexed by those 
descriptors. -.Sample citations can be exa- " 
mined and the, retrieval modified on-line. 
When the references generated by the search 
are appropriate, the complete bi bliography is 
produced in Santa Monica and mailed to the .. 
EISO search service room (S208) for pick* 
. up, of directly to the requestor. 

Complex requests handled quickly 

The system makes possible quick and ef- 
ficient handling of complex, hard-to-define 
requests. The compute? search itself ]takes 
about 15 minutes; usually following a 30- 
minute - interview~with the" search ^analyst. - 

•The print-out arrives less tharia'week later. 
'Current charge for a complete search, in-^ 
eluding consultation and printed biblio- 

• graphy, is $30. V ■ 

Thp last phase of the EISO service in- 
volves ordering .documents, and articles'. 

V.Photocbpies of articles or microfiche copies 
of the documents may be 'ordered from 
EISO at 104 a page for articles and 354 per j 
fiche. \ / 
_Jn addition to the. operation in Toronto,) 
the project staff are . working with Institute 
field- centre personnel in order to introduce 
the service across the province. The North-, 
eastern region, with its centre in North Bay, 
has tfeen selected as a target area for inten- 
sive research. " - 

Further information about the " project 
can be obtained from either of the principal. 
_ investigators. To request a search, an ap-' 
pointment may be arranged with the search: 
analyst at Ext. 487, or 923-2936. - 



I 



i vous vputez 
parler francais.. 



Staff members and students interested in 
improving their French language skills can 
enroll in Lunch and Learn French, a course 
to* be held at OISE during' the noon hour 
beginning Oct. 3. The course; offered by the 
School oCContinuing Studies of. the Uni- 
versity of Toronto, will . meet Monday, 
Wednesday, and Friday for ten weeks. In- 
struction will concentrate on the develop- 
ment of speaking fluency and*aural compre-. 
nension. The course is designed for those 
who have already acquired a basic knowl- 
edge of the -structure and - vocabulary of 
French v but.who cannojt'speak.it well. The 
fee is $75. Students may register, by mail or 
in person, at lt-9 St. George S.t. the office is^ 
open 3 a.m. "V 9" p.m. tyonday through 
Thursday and 9 a.m. — Sp.rn. on Friday : 
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GRADOISE Press (OISE) 
4 (5) Oct. /Nov. 1975 , 



The Educational Information System For Ontario 
_ _ , (EISO) Project ~~~ 



•Thanks go to Jutta aLrylwcrth for ELSO 
Following a successful six-week period of trial 
operation daring the OISE Graduate Summer 
Session, the educational information service 
provided by the gdacatkmal Information 
System for Ontario (EESO) project* has been in 
full-scale operation since September 2. 

The project's purpose a to plan and teat way» 
to increase the accessibility of educational 
literature to Ontario educators. The first stage 
odft has process, is providing computerized 
^searches of the Educational Resources Informa- 
tion Centre (ERIQ data b«c. ERIC it an 
information gathering and dissemination' 
network comprised of. 16 subject-specialized 
c le a ri ng hou s es operating under the auspices of 
the U.S. National Institute for Education. The 
clearinghouses collect, index 'and abstract 
research reports, conference papers, curriculum . 
. ■ materials and handbooks, including many from * 
Canadian sources, and an no unce them monthly 
in Resources in Education {RJE\. They also 
index more than 700 journals, j~-l nflfny 26 ' 
from Canada, for the second major ERIC 
pu b l i cation. Current index to Journals m 
Educati on [CIJE\. In all, the ERIC data base 
i ncludes over 200,000 references; JUE and CIJE 
are updated monthly by the addition of^over 
■J 2500 citations. (The OISE Library already has 
an extensi ve collection of journals to provide the 
: back-up material to CIJE* and the complete 
• ERIC doenxnent collection on microfiche.) 
— ^EISO provides computerized access to the 
information contained in these two files. 
jl retrieving references quickly and inexpen- 
w . '■' stvery. . ' 

The flexibility of the system allows for easy 
and effif«Ttf ^ handling of extreme «" rm ip lf* > _ 



infoe aua tio a 

hard-to-define requests. In terms of speed of 
service, the computer •search itself normally 
takes fifteen minutes , but follows: a half-hour 
discussion or interview with jthe search analyst 
wherever possible* The bibliographic printout, 
complete with abstract for RTF **tniirTm r will 
usually arrive within a week of-rcceipt of the 
search request. As for cost, the current charge 
for a complete literature search. 
consultation and printed bibliography, is 
$50.00 y 

The last phase of the information service 
involves ordering , complete dpcuments 
articles. Each reference in the computer- 
pHruedhibliography will be identified by an ED 
(ERIC Document) or EJ (ERlC Journal) 
number. The documents are on microfiche 
are filed by number, so that ordering by 
number u .'required. Journals, on the other 
hand, are shelved by volume, tame and year of 
the specified journals, so articles should, be 
ordered accordingly. Photocopies of the articles 
or microfiche copies of the documents may be 
ordered from EISO at 10c per page for article* * 
and S5c per fiche. (Paper copies of docurnents 
are available from the ERIC Document 
Reproduction Service (EDRS) in the United 
States,) Order forms for both docurnents and 
articles wiU be given or sent m clients after their, 
searches have been completed. 

For additional info rrnaraon aoont t h e p ro j e ct , 
principal investigators, Dr. Steve Lawtoo 
1 Mrs. Ethel Austcr. may be reached under 
654 and Ext. 420. respectively. To request 
(search, an a p p oint ment with the search \ 
analyst. Ms. Reicker. .may be arranged by 
veiling either Ext. 4S7, or 925-2936. 
^ ".. . *' ~* * * ' 

poFunded under contract with the Ontario 
Ministry of Ed ucati o n , # 
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Bibliographic notes 

X new project housed in the 
OISE library in Toronto assists ' 
educators, by providing com- 
puterized bibliographies to fill 
spedfi^ information — needs, —~ 
Through ite search service, the 
Educational Information Sys-^ 
tern for Ontario' (EISO/ pro- 
ject^ funded by a. Ministry, of -s 
. Education: contract, provides^ 
\ direct access to the Education- 
al Resources Information Cen- 
ter (ERIC) <la ta base, a store of 
information containing over- 
200,000 references. Relevant ■ 
citations from the two ERIC 
publications, Resources in 
Education (RIE) and Current 
Index to Journals in Education 
(CIJE) 9 are retrieved imme- 
diately (on-line) via a com- 
puter terminal operated by a 
trained search analyst. 



The service began full-scale 
operation on September 2, foK 
lowing a successful trial period 
during the summer*. It, is seen 
as especially helpful ro^those" 
educators working under the 
pressure of deadlines and to 
those engaged in planning and 
decision-making in education- 
al institutions throughotit^ the_ 
province of Ontario — class- 
rooms, school board offices, 
research centres, libraries, 
community colleges, teachers' 
colleges, universities and pro- 
fessional organizations. Com- " 
plex, hard -to-de fine requests 
are handled quickly and effi- 
ciently. 



In addition to its service as- 
pect, the EISO project in- 
cludes an extensive research 



component investigating the 
information-needs of Ontario 
educators. The Northeastern 
Region has been selected as a 
. target area far in-depth xe- 
search related to the provision 
of local Educational Informa- 
tion Consultants. "(EICs) to 
assist in requesting and* inter- 
preting educational -informa- 
tion. To this end, EISO clients 
will be asked to coinplcteeval- 
uation questionnaires or agree 
to be interviewed. ' 

Further information may be 
obtained' by contacting the 
principal investigators, Dr. S. 
Lawton and Mrs. E. Auster, 
Department of Educational 
Administration, , OISE, 252 
Bloor Street West, Toronto 
M5S 1V6. -Ethel Auster 
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APPENDIX J. 



Activity 



Professional Development Day 
Educational Information System for Ontario 



5 



-Minutes 



• Equipment 



■;.w L """ Background bT s tudy 

.' _2 -. . V- 

., ONTERIS project 

' Why use EISO? 

. *- \ 
Introduction -tp ER.IC 



ERIC documents 



Canadian content of ERIC 
Type of information retrieved 

Ordering miirfbf iche *or paper 

copies of journal articles- 
Request for sample topic 
Negotiation of question 
Sample search 

Closing remarks 



- ~5" 
2 
3 

10 



r^^ISO r Contract 



3 

i 

V 3 

5 
2 

5~ 

20 - 6 0 



.A. 



ERIC Thesaurus 
Resouces in Education 
Current Index to" Journals 
"in Education- * 

Microfiche sample 



Sample SDC bibliography 



Order forms 



ERIC Thesaurus 

Telephone 
Computer terminal 

EISO brochures 



Total time: one to two hours . 

Host to supply: telephone in meeting room 

. -{EISO covers long distance costs, if any) 



EISO . participants : 



/ 



Dr. Steve Lawton, Principal Investigator 
Mrs. Ethel Austeir, Principal Investigator 
Ms. Elizabeth- Reicker, Search Analyst' 
(Normally, two of these three are involved 
in any one presentation) 



ERIC 
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APPENDIX K- ; Educatipnatl Information Consultant; 

*. • i Roier Description, and Training Prograi 



Role 



1 . — Gaibr access to- po-tential : users 



. A ■ 



w 

v 



? s ' a) : Lety- clients know you are there and why . / ■ f 
b) Describe service you can offer ^ 

2. In cooperation with clients, .ideht^^; their 
information needs ^ 

3. Help forniualate problem .., 

4. " Relay request to. EISO search analyst at OISE 

5. Delivey and interpret bibliographies N > 

6. Assist in ordering complete documents. . 

7. Follo^— up and evaluation ■.>..'. 



V 



" *?■ 



s 



■ERIC 



• EDUCATIONAL DtFOHJATIOH' S^STQt FOR ONTARIO 

. .- .' . r ■ - • ■ 




;l:30-10:00. 



OISS and Library Tour 




.0:00-10:20 




19:20-11:00 



Beviev .of Project 



Introduction,^ searching 
(Manual) • 



a:l5-12:-30 




12:30-2:00 



piient approach and EIC role 

vis a vis client. 

EIC role vis a vis search 

analyst. 

Search analyst support function. 



Familiarity vith functions, 
.^oiit, people*;:) : 



to 



f Library.i 

Ains ind'scope of koject, 
Reporting network in 




o 3. 



how to use ' ME) CIJE 
' • Ihesaurus , Journals, microfiche 




Knowledge regarding client 
approaches. . *■ . 
Knowledge regarding EEC 
'response. 



OISE Bulletin, Liorary Guide, 
r & D Studies, Annual Report. 



• reporting network. 

I^Vof project;' staff . 



EA, SL 



Contract copy. . 



.,. ... RIC, CUE, fiche, Thes^iiriis * 
FaniUarity vith contents and,)* J urnols,- aicrofichw ■ 



EIC role description, k 
Chart shoving approaches 
Search Fori (saaple). 



EA, SL 




SL, ER 



Lunch 



12:45 Le Trou .Norland Reservations , 




0 



. 5:00-5:15. 



Review and evaluation' of" manual 
search. 

Computer search. 



Ordering documents. 



^.Understand search] 
'b).Me^tand:Boo\.an.Lo'gc 
c). iearch strategy using 
». .thesaurus. :'v . v ' ■ 
• il Ability to negotiate requests, 
; .and translate into' nachine- ' . 
readable : fon?at. : . 




Independent ability. to. do. tnanua! 
searcly 

Familiarity vith search methods 
and. output. 



d) : SDC Materials ':'' t 
'b) Thesaurus 




$5:15-5:30, 



Wrap-up, questions. 




ERIC 



V ■ 



Ability to .ohtain original 
docuaents, 'journals, fiche cojJies 



cojle 



afTerninal 
b) Bibliography . 



Order forms. 



y 



■ & ; 



ER 



'ER 



f ■ 
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Educational Information System for Ontario C 

rhe Ontario InStituW'for Studies In Education 0 • '" * 
252 Dloor Street West, Room N75.4 • * :' • 
- . Toronto, Ontario M5S IV6 .'/■■"•> . ■•• 

Evaluation of Training Session for Educational 
'>-- " Information Consul ta^nt Yri i Worth Bay 

: ■.. v^-* > ' ' ' "■■ 

J. In general, how wo.u I d you rate the adequacy of the" training session you 
underwent .to become, an Educat lona I. Information Consul tant (El C-)"for the 
Educationar.lnformatibn System for Ontario CE ISO) project? 



•Excellent ^_ Good '• Poor 

. • . ■' ■■:'(• , - . ~" - - '-/ 

Comments i . r > . ^ 



"2. Overal l> what was the. practical value to you of -the Information or assistance 
.that you -received from. EISO staf f. during your training session? •• - 



Very ireful 
Moderate I y usef u I 
Only slifltfrtly useful 
Not useful 



Information. - - ^ t Person af' assistance 
(forms, samples) (EISO staff) 



Comments: r ^ '• g \ 



• What do you see as your role as an EIC a result of your EISO training? 



3 



Please give, y<?»r opinion of the to 'I lowtng_.statements rogarding. your El SO ■ 

' tralp Ingress Ton. • 3 ' ; ■*' • . 

Longtb of training session: p ..... . 

g > ' too -I ong . • too »short ' _ just right • 

Amount of dots! I or specificity conveyed: . • 

tot ■ ' ... 

too much . too Ji-rtlcP .just right 



Level .of troatment ot sessions provided related to-your- needs^- 
too complex . too simple J just right 

Comments-: " . • . • " 



Please ra-to the train fngi session with regard to ^he fo4 lowing ^I+ems. 

^ . . Excellent Go^d , .f oo r 



Explained clearly tho pofrpose^ and- 

services of the El SO project j — t Lll — i_ — —4- 

Defined wo-l I what EIC role i rw^+ys4 > - l_ <—i 



"Taught me to use ETRIC indexes ind - 
thesaurus - 

- - ■■ . • 

Explained hotfv to formulate search \ 

strategies for manual and automated 

retrieval ■ ■■/.. ..j — . Y— 1 

Taught mo 1 how to read- and interpret " 

a computers-gone rated bibliography I_ — — — ^^i— 



Taught .me procedures for order! ng k 
microfiche and paper copies of 
original documents - ■ . 

. Comments: ^3 * * ■ ' 



1 ' 



6. How ttpuid'you rank t" ho following influences In holping you to loam how to 
bo aiTEIcr <P I noo.tho number "1" for most important, "2" for next In 
important, etc.). y .. , . 

" . trial and error in dealing with client 

. - advice from ql loot j> 

: • the EtSO training program and^St^ff ^ 

' my own previous experience working in the field 

_j literature I have read on the rolo of change agents or knowledge 
dissemination and uti I i zat ion * * 

. discussion of my rolo with other EtCs 



•» advice or help from dthec^rco I leagues 
(Please specify name and position) ; 



other (Please specify). 



Comments: 



7. How often do you use the El SO service in the course of your normal duties? 



Frequently ^. "__!__ Sometimes Never 



G. Has your EISO. tral ni ng inf I uenced "the, way you approach' youK norma I duties? 

■ -V . • Yos , . ■' Nq 



f f.-\Yes „ p lease speel f y : 




.What activities do you-' engage in as an ElC? 



I0.o Which sources* do you turn to most of ten when you require educational 
information? , 



II. What problems are you encounterlr^f in your role* as EIC for which your EISO 
training aid not prop a re you£. 



12. In what ways wquld you recommend that the training of EICs by EISO staff 
be changed or improved? 



Please use the^remalning space for any additional . comments you would like 
.to make. m 



fr, Please return \o\ir completed questionnaire in the envelope provided to: 

, Mrs. Ethel Auster : / .. . 

H "Department of Educational Administration, N754 

Ontario Institute for Studies in Education ^ • ^ 
7.152-13 1 oor Street West 

Toronto," Ontario ■ - ' . * p 

Wj$ IV6 



v 



"4 

THANK YOU VERY >1UCH 



5 v 
P7065252 



THIS IS AN OFF-LINE CITATION LIST GENERATED BY 



*' • ; ORBIT 111 



/ , * 

» s'.D.C.'S INTERNATIONAL SEARCH SERVICE ' . ? 



* 



/ 

" -r- v ---y— 7 ADUlT '.EARNING SEARCH N0~402 . " 

' ' •/ ' •'. • ' • • ' - .- • 

NUMBER OF CITATIONS PRINTED ■ 43 1 FEBRUARY 17, 1976 

-THIS SEARCH WAS PERFORMED ON ERIC . 



REQUESTED BY . ' 
R ALLEN X357. 



PLEASE SEND THIS LISTING TO ' , * • j 



S E REICKER, -EISO OISE, ,RM S208 . V 

252 BLOOR ST W . ' " \ 

TORONTO ONTARIO CANADA *M5S 1V6 . 



PAGE 



^ADULT LEARNING SEARCH NO 402 



ERIC ACCESSION NUMBER 
CLEARINGHOUSE ACC NO 
AUTHOR '. , 

TITLE 

PUBLICATION DATE *. 
I&UE 

INST ITU TJONAL^NAME 

EORS.. PRICE 
AVAILABILITY 



DESCRIPTIVE NOTE 

DESCRIPTORS 

DESCRIPTORS* 

DESCRIPTORS 
C DESCRIPTORS' 
' DESCRIPTORS 

DESCRIPTORS 
/DESCRIPTORS . 

DESCRIPTORS 

DESCRIPTORS 
DESCRIPTORS 

DESCRIPTORS ! 

DESCRIPTORS 

DESCRIPTORS 

IDENTIFIERS 
•IDENTIFIERS 

ABSTRACT 



A COOPERATIVE LEARNING 



E0108747 
PSO07929 
CONRAD. EVA 
PEER TUTORING: 
EXPERIENCE. 

7.4 . . ■'•'•. < '" , 

RIE75NOV 

.ARIZONA UNIV.. TUCSON. ARIZONA CENTER FOR • 

" EDUCATIONAL" RESEARCH~AND" DEVELOPMENT ; 

EDRS PRICE MF-S0.76 HC-$^;95 PLUS POSTAGE 

• INFORMATION. OFFICER. ARIZONA CENTER ■fOR v 
EDUCATION RESEARCH AND DEVELOPMENT, C0LLEG6, 

, OF EDUCATION. UNIVERSITY OF ARIZONA. TUCSON.^ 
'■AZ 85721^ (PAPER. $1.00) 

29P. " ' ' • =» , 

♦ELEMENTARY EDUCATION 

ELEMENTARY SCHOOL* STUDENTS 1 e . 

♦INDIVIDUALIZED INSTRUCTION * % 

INDIVIDUALIZED PROGRAMS 
PEER RELATIONSHIP 
•PEER TEACHING 
REINFORCEMENT * ■ k 
SMALL GROUP INSTRUCTION 

TEACHING TECHNIQUES ' . • 

TRAILING TECHNIQUES 
♦TUTORIAL PROGRAMS 

♦TUTORING .v * 

TUTORS ' ' •' 

ARIZONA \ - 
♦TUCSON EARLY EDUCATION MODEL 
THIS BRIEF ILLUSTRATED BOOKLET SUGGESTS 
PROCEDURES. FOR THE INCORPORATION OF PLANNED 
PEER TUTORING INTO DAILY CLASSROOM ROUNTINES. 
THIS METHOD. OF INSTRUCTION HAS BEEN" FOUND TO 
BE "USABLE*' WITH -A. VARIETY OF ACADEMIC TASKS \ 
AND IS SEEN AS ONE WAY TO ACHIEVE 
' INDIVIDUALIZATION OF INSTRUCTION. THE BOOKLET. 
FOCUSES Of/ THE DEFINITION OF PEER TUTORING; 
BENEFITS OF- THE TUTEE.- TUTOR AND TEACHER: . 
TUTOR TRAINING TECHNIQUES : APPROPRIATE 
TUTORING' TASKS (GROUPED' BY ACADEMIC AREAS): 
APPROPRIATE MATERIALS; AND RECORD- KEEPING.. A 
BRIEF LOOK AT HOW ONE TEACHER USES PEER 

• TUTORING IN HER CLASSROOM -IS INCLUDED* (£D) 
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APPENDIX M. - 'Sanple Micarofiche 



4> 



c 



J 



(7 



9 

ERIC 



l9o : 



j APPENDIX N J Business Forms -for EISO 

' j . - - . 

. ' EDUCATIONAL INFORMATION SYSTEM FOR ONTARIO 



.-' The Ontario Instate for Studiesin Education' 
Room S21 8. 25?Bloor St. W., Toronto M5S 1V6 
{416)923^641 Ext, 487 



1. Name. 



Addrets . 



k " . 184 

Search. No, ■ ■ ■ i ■ i 

Triple , j 



SEARCH REQUEST FORM (completed by search analyst) 



2. Jnvdice: ( ) Same, or 



Phone J L 



3. Bibliography to: 



r 4. Search Topic: m Year(s) to be-searphed ^_ 



Detailed description of topic — 



Level or group • 



5. Reasore ^requesting search (Please specify how you bopfc to use the information) — 



6. Number of ref erehces expected : . 



* 7. Number of references dttffred: 

-.1 



*15. Citations of relevant materials known to you, rf any, or authors writtrig in the area 



9. Data base: . ' ERIC □ SSCI □ * . PA □ OTHBR* □ 



10. Search strategy 



11. Comments (actual form ±s /l4 inches long) 



Copied- EIS<|>(1) white 

Requestor (1) pink 



EDUCATIONAL INFORMATION SYSTEM FOR ONTARIO 

,•* »■ - ' 

Th» Ontario Institute for Studies in Education 

:' / Room S2J8. 252 Bloor Street W., Toronto M5S 1 V6 
\ (416)923-6641 Ext. 487 



4= 



Search No. J__|__E L I I 

Topic: < • . 1 " 



SEARCH REQUEST FOR'M (completed .by EIC) 



_t_1. _Name_ 



2. Invoice: ( ) Same, or 



Address 



u - 



Phone - {_ }_ 



3: Bibliography to: 



Phone 3t H. 



/ 



L Search Topic: Year(s) to belsearched — . 
Detailed description of topic — 



-0' 



Level or group — i 




5. Reasons for requesting search (Please specify how you hope to -use the information) — 



6. Number of references desired: 



7. Citations of relevant materials known to you, if any, pr.authors writing in the area. 



8. Price: 
9'. Contact: 



Free □. ' " 
In person- D 



10.* * Date request received 



Length of interview . 



.$20 □ . " ; $30^ □ ^ 4 



Telephone □ 



M 



Mail □ t . . 
to . » * 

Date Of intpnfipw T I 11 1 t V 

- ". ■ ■« D * M" - Y ? 



mm. 



11. Does the clfentthave access to microfiche reader? * Yes □ 



No □ - Dori'i know T2 



EISO Reader? 



Yes □ 



No 



Don't Know □ 

'jp 



ERIC^'*^-' ■• .""..'Cedents Cact»l £~ U" long)- ' Copies '- EISOJ^ *^«««. 



• iii 
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1) ' Name: 



V 



EISO Search Request Form (completed by user) % 
_ ■ J 7 2) Invoice (if payment is not enclosed): 



Address: 



I t— 

Phone: I — ^J- 



3) Search Topic: Grade level Cs) 
Detailed description of topic — 



.Year(s) to be searched — _ 



V 



- 4) Reasons for requesting search (Please be specific, giving examples of how you hope to use the information) - , 



/ i 



r 



5) Maximum numberjof references you think possible -. 



« t 



7 S I 



6) Actual number of references desired for use 



i ■ 



7) Citations for relevant materials known to you, if any - -- 



. t 



8) Authors writing in the area, ot^er than those cited above 



5 , 



~r. 



Please mail completed sear^i application^ ' 

EISO Search Analyst 
OISE Library 
252 Bloor Street West 
Toronto, Ontario M5S 1 V6 



I a 



\ 



9 

ERIC 



Ml 



fry 



• - EDUCATIONAL INFORMATION" SYSTEM ' FOR ONTARIO 
REFERENCE\RECORD > ' 

t _ 



iv(l) 
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Dates of 
Search 



Search # 



^ame 



No; of Refs. 



, Dates 
Received 



/. 



\ 



ERIC^ 



t 7 



19S 



-r 



-/ 



iv(2) 



Search Log (Search Analyst) 





.Daily 




II • • ' - 


Weekly 






Date 

• 


.Time 


Print 


- 

.No. of * 
Searches 


■ Total 
Time 


Total- 
Print 


Time/ 
Search 


Search 








J .-_ 





1 — 






^ if'". 


* 

/ 


4 

A 




i 






















V 


- 


\ 


- • 


f 

- 








- 










- 






• 


V > f 






- 


9 










/ • 

i 


<*~ 
*- 

/ 

V 






I 


_J 


; 




• 
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A bibliography 'containing 

t 

computer centre 



references on 



% is on Its way 1j> you f ronr ttre SDC 

re in Santa Monica. v 



We are enclosrng an explanation of the printout and order forms 
so that you may order copies of the documents from the El SO. Photocopies 
of journal articles cost* 10<? per page, dupllqgtes of each' microfiche are 
35<f . .Hard (paper) copies of the documents must be ordered from EORS, on 
the form enclosed. AM orders to EISO must be prepaid if the total Is 
less than $10.00. - / 

If you have any problems please do not hesitate to write, or , 



to^ telephone me at (416) 923-2936. 



>• • •» 

Sincerely yours, 



SER/ay 
s Enclosures 



S. Elizabeth Reicker 
Searcfr Analyst 
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Understanding the Printout ^ 



^The printout provides full bibliographic references — enough 
Information to decide if/ the paper should be read (abstract & descriptors) 
_and to_. ret rf eye_t he .document 0ED# ..or _ Jpurna L _t t+ J 

There are two types of references corresponding the two . . 
Indexes which comprise the ERLC data i>ase. ^References with an ED crefixed ? 
accession number are reports from the RfE portion of the file; almost all 
the documents so v indexed are available on microfiche. The OtSE Library 
subscribes to. the complete microfiche col lection In which the reports are 

n ■ a - ■ 

kept In order of ED#. ^c~e copyrighted maTgrials are not available on 

- j »^ ' " ■• 

mlcrof Iche^-detaTI s to obtain these are provided i 4 n the descriptive note 



category. Most of these monographs will be ava i tebte'' In the OISE Library. 

References to journal articles are assigned an EJ accession 
number. .The document will Jbe J ound i;n "the journal specified under -"source". 
Issue, number and pages are also given. AM of these, periodica I s are held 
at OISE.. ' / / ^ - ^ " V - * , 

If y^u have any difficulty in finding the references, or rf-you-^ 
require the documents V>r articles, for your event's or your files/ the 

' . - ' . ■ . ' ■■ " < v * . : 

E!SO project staff wt IT> be pleasec -o photocopy jburna^J articles and 
.reproduce microfiche for a charge" of 0*/page and 35C/fiche respectively. . / 
The EISO is not able to pre :de paper copies from the microfiche. Prepaid 
requests for' such copies s^ouii be directed -to,EDRS (ERIC Document Repro- 
duction Service) in Arlingtori, Virginia. . 
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PRINTOUT $¥MOBLS OF THE ER-fC DATA BASE 

^^^^ , r 



r 



ED OOO 001 (ERIC ACCESSION 
' . -* NUMBER) « * 



EJ 000 001 



AU (AUTHOR) 



ERIC accession number for. document reproduced 
on "microfiche. This^information is required' 
When- ordering a duplicate of* a microfiche. 

^<The document, on mfcroflche Fs filed .By^thls 
number in the microfiche cabinet in the south r 
central area of 'the I Ibrary^ second floor. 

Thesfull citation including the abstract and' 
.x, descriptors may be" found in^ Rl E Documents % 
~* Abstracts^ CNavy blue vols.) to the west_of the 

m i crof i ch<b co 1 1 £ct i on . • fr 



i^ 



Refers t& a Journal - article Irtp6xed In CUE. 

To learn the source. of the article look up 
under the EJ number In the Marn Entry section 
of CIJE\ (the bright blue volumes J n the area 
for index stands). * 



Author of "the article or document. 



Tl tTITLE) . \ 

") _ • V 

PD '(PUBLICATION DATE)- 



DE (DESCRIPTORS) 

I£)ENT I F I JERS j \^ 

r - 



AB. (ABSTRACT) 

NO (DESCRIPTIVE NOTE) - 



Title of the article or document. 



Publication Date of<the article or document.. 

\ 

Those with Jlls Tp front are major^escrtptors 
which reflect th^main content or thrust -of 
the information* - 



Abstract of the- ERIC document. : >■ '" ' > 

* i ♦ 

Information about avat lab i II ty of the 
document if "not on microfiche and the cipher 
of -pages of- the documents ' ■ 



SO (S0URC£)' 



7 



Source of the journal articles Journal Voi^e. 
Ijssue, and Pages^umbers. This information Is 
required when ordering a* photocopy of a , 



req 

jou r na J article 



c Oj: research project is funded under contract -by the Ministry of . Education, C^T=rio, 
fc iyl C - » . ' - ' * 

2 V J » „ ■ - 
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v*«* * ... Address ■ - 



M Date 



- EDUCATIONAL INFORMATION SYSTEM FOR. ONTARIO • ' 
'OISE Library;, 252 Bloor St./W".., Tororifo M5S 1V6/ 
ORDER F0B£! FOR Md CROF I CHE AND ART I CLES ~. y . . . 



fe'iopfione'' t ) g 



•.«s 



"El SO 
'Search # 



", ^ERIC. "Documents, on Microfiche 



ED $ 



-7* 



3? of f i che 
(96pg/f iche 



i ' 



# of 
cop I es 
— > 



Cost. 
(35<t/f Iche) 



Total 



Completed by user -and sent to EISO 



Journal Title 



(Continued on next page) 



ERLC 



204 



----- 



vii(2) 



193 



Pt\t\a of 



Payment^ ehclosed/L 1 (nedessary for orders gnder : $10.p0>- 



Journal Artfcles 



•Note: Actual. form printed horizontally 
on 14" paper* 





f— — 

VoJ 


Issue 

S 


Da+e 


of Pages 


#. of 
copies 


.... Cost 
<10C/page) 
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THE ONTARIQ INSTITUTE FOR STUDIES IN EDUCATION 

252 BLOOR STREET WEST, TORONTO, ONTA R IO, CANADA M55 IV6 J TELEPHONE 923^6641 




V 



Thwik "you 1 ■ for OFder i n§ .nricr© f -i cf it*- "^antt photocop-fces .from EtSO. 
THE TOTAL CHARGE IS $, ■ Please remit to E ISO v ^hen your * 

payment ts received, we will forward you copies. A stamped and 
addressed envelope js enclosed for your convenience. 

Unfortunately , the following documents and Journals are 
not aval table frpm 01 SE: d v • , * - 

"Document or Journal " z • ' 




Held by 



Not available from EDR§ 
Not" held by OISE : 
Missing f rom 0 1 SB \ - ^ 
a ^Inybtndiery-^ay^I ;lable In 8 weeks 



and available via Inter! Ibrary loan* 

If you have any quest ions please write to me or telephone (416) / 

« ■ Stncerety *yours/~ 



923-2936. 



SER/ay 



S, Elizabeth Re I cker 
^Search Analyst 



• . - ORDER FORM 

HARD COPY. OF ERI€ DOCUMENTS. .. 



/- 4 



. SEND TO: ERIC? Document' I^ixxiucfcLan Service 
P.O. Box 19&, Arlirigtdn VA 22210 . . 
* ; ■ - ~' Phone. 703 841*1212 t 
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SHIP TO: Naome 



Date Ordered 



*4 . 



. Address 
♦ fhdne. " > 



Cheque dr : ncn^ order irf tf.S. fui(5cls* 
^^yable to &RS must -be 'enclosed 



■ r?9 . 



' v ■ ■ - - : 
No. ?pf pages " 

\ *lr25=- - • - * ; 

26-50 ; . ■; 
• 51-75 '■■ 

76-100 * , 
each 'additional 
25 pages 

Postage: - 

First 60 pages 
Each additional 

- 60 pages ? 



Prices ~ * V / - 

! •: ■ ¥ 

Price L 

: : " '■ 

• $1.58- tf,S. ^ 
. 1.95 V ■* 

3.32; • 

. ,-4.43 w \* 
1.27 v ^ •' 



0.18 
0.08 



ED 



ED Number 



ED 



ED 



ED 



ED 



ED 



iED 



ED 



ED 



ED 



No. of Pages 



$ - 



1 



Please sent 1 copy of this form to, . - 

KISCV QISE Library, Rn. S2l8, ' 
252 Bloor St.-W., Toronto, - Postage 

Ontario M5S 1V6. ' ; v. 

Blis is required for Total 
research purposes. , -.^ 



$ - 



Sound to' nearest 
- . cent 



V^ersribrt.A 0 
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■ x± ' 'Dates Coyered 



DEPOSIT SLIP 

' »'EducaViona! I nfornat'Ton 'System for Ontario ,V — _ 

....... ' A ; - . ^ i , . • \ , . . 

'^ie'ase credit the attached cash/cheques\ to account 95.90 - 5551-51 

Purpose 



Search Number^! 



. . Cash 



-3_ Cheque 

s . ■ r 



Search ' Fiche- Paper Other 



V 



TOTALS 
Sent from EISO: 



(Signature) . 



i (Date) 



'^Received .In Banking Section, Finance: 



(Signature) 



(Date) 



Copies - EISO (l) white 



OISE Finance (1) white 



'1 



9 

ERIC , 



2 m 



THE ONTARIO INSTITUTE v 
FOR STUDIES IN EDUCATION 



xii 



1984' 



2SS2 BLOOR STREET WEST, TORONTO. ONTARIO, CANADA M5S 1V6 * TELEPHONE923-6641 ' 



■.A 



jL 



INVOICE 



* EDUCATIONAL INFORMATION SYSTEM FOR ONTARIO PROJECT* 



INVOICE TO: 



(COMPUTER SEARCH OF ERljC DATA BASE 
, Search conducted for ,vT 



INVOICE NO. * 
INYPICEDATE - 
CUSTOMER NO. 



EISO SEARCH NQ\, f 



\ •••• 



A 



.V. 



Date of search 



MICROFICHE REPRODUCTIONS j 




Microfiche @ 354 per f iche 



PHOTOCOPIES 



Pages at 104 per page 



•This project is funded under contract by the 
Ministry of Education, Ontario. 



r 

v 



TOTAL 



T£RMS: PAYABLE UPON RECEIPT OF INVOICE . 

MAKE CHEQUES PAYABLE TO THE ONTARIO INSTITUTE FOB STUDIES JN EDUCATION 
MAIL: ATTENTION FINANCE DIVISION — BANKING SECTION 
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Copies — Customer (1) white; OISE Finance Division (2) blue [returned to customer] 
and gr^een [Finance copy]; EISO (1) pink. 

--EASE RETURN REMITTANCE COPY OF THIS INVOICE WITH YOUR PAYMENT /CUSTOMER'S COPY 
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'■ ' * / EDUCATIONAL^INFORMATION SYSTEN1FOR ONTARIO (EJSO) 



/§§arch/Authori2ation Form 
(Cb$t Recovery for 0!SE Staff & Students) 



V 



auestor i : — _ : — ■ ' v & 



Requ&stor 



- * 5 o*-* 



V 

Unit 



Authorization by unit head 

-or budget officer p , 1-^- ; — '—— 



Account Number 



■ EISOCOPY - 



Copies - EISO <2) white -and green; white copy sent to OISE Finance with Summary 
Budget Unit (1) blue Form at month's end,. 

Requestor (1) pink ■ ' 
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• " Summapy af "Account DT stri but ion . 



Dates ' .Covered 



- Account y \ 



Budget Unit v 



Cost< 



• r 
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Copies - EISO (1) white 

OISE Finance Division (1) white 

Submitted by 



(&ISO) 



Date 
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Library-/ 
Assistant 




Type- 
writer 



.A • 
• Microfiche 

Reader . 



j. 
I 



Telephone 




6 



To ERIC Microfiche 

and Journal Collections (same floor) 

)To Microfiche Duplicator and 
Paper Copier (one floor up) 



Storage 
Cabinet for 
for forms' and 
supplies-." 



Search 
Analyst 




Client \ 



Tape 
recorder 



Computer 
Terminal 



Telephone 
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APPENDIX P. . Search Analyst \ 
Position Summary : v 

• Under direction of the Principal 'investigators perforins a variety 
of professional duties, but -not limited to: providing automated biblio- 
graphic search service from the OISfi/Library for Ontario school board 
officials, OISE staff, students, and field centres, administrators, 
consultants, and* other p;rof essional t educators, providing orientation 
to the search service -for OISE staff students, membersof Ontario's 
educative society, members of government and professional associations, 
other search service users; preparing 'training materials in the tech- 
niques and use of automated bibliographic searching:/ scanning- literature . 
for current awareness; acting as liaison be tweep scfarch service and library 
and project .staff and users; supervising Library Assistant-. % / 

Duties and Responsibilities : 

502 1. >J*6vldes automated bibliographic search service for Ontario 
. ^s&ool board^ officials, OISE staff ,. including field centres,. 
• -J students, oth^r J members; of Ontario's educative society, members 
; of government and professional associations by: 

a) conducting in-depth reference interviews with users. . . 

b) compiling search strategies to fill the requests. 

c) j^gerating computer terminal in interactive- bibliographi.c * 1 

searching. # ( 

^ d) maintaining explanatory correspondence with service's xxsers^; 4 

102 .2. Provides orientation to OISE staff and, students, other usei£ on .j. f 
.techniques of automated bibliographic searching and use of the v 
^search service. 

102 3. Prepares training materials in the techniques and" use of auto- 
mated bibliographic searching. . ■ * . 

■r *■ 
52 4. Collects data on the service by accurate record-keeping. 

. r 

52 5. Suggests improved .procedures andf policies to Principal Investlgatoi 

^ / ',>.-.*. • • *- 

52 6. Scans educational and related journals for current awareness. 

52 7;" Acts as liaison between the service and Library staff , Principal 
Investigators, users. 

52 8*. Monitors the operational efficiency of the commercial services 

u^d. ; \ * . K "* y " v J 

52 9. Supervises Library Assistant working on the project. 
Auxiliary Duties : 

Attends project and professional meetings and T performs other related 
- duties as required. 

Work Complexities :- 

A. Choice of Action; \ 

Exercises professional judgment in compilation of search strategies 
* ■ to - answer automated reference requests • Exerci£es : p*o£ essional 
judgment ensuring smooth- running efficiency, of, the search service. 
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B. Consequence of Error: 



ERIC 



1. . Errors in judgment lu -eompjtrtotion of se arch strat egies 6r failure, 
to accurately interact with ^automated information could result in 



— -> —'——^ frustration and-delayta educators and 0thers T -4iave -a wide-ranging 

v ' effect on Library, project, and, Institute public relations through- 

- - out Ontario. ^ - <w &. ■ V * . 

* 2. Errors in judgment in data collection could seriously undermine 

" _ the accuracy and reliability of -the data analy sis of the project. . ) 

\ "... C. Difficulty: 

1. Assessing the true needs of patrons submitting vaguely-worded 
enquiries. ■ • J > ; ■■ 

2. Working as an integral part of both library and project staff » * 

3. Keeping abreast of latest developments in data base usage. 

'~ V V . 4. Working with numerous interruptions due to open plan of library. 

facilities. \ 

5. Patience and flexibility in overcoming difficulties associated 
with implementation o£*& new service. 

D. Contacts: * , *? 

v . \ 'j Frequent contacts with Principal ; Investigators, OISE students and staff, 

■ r " ' school board officials, research assistants; non-0 ISE students and 

K^'~y ■"' - librarians, educational and professional associations; and field ■■ v 

/ * centre personnel, and "government officials. . 

Supervision Received : 
Direction 

Supervision Exercised : 
s A. Number of employees supervised: Directly 1 r 

B. Highest level .supervised: Library Assistant - 

C. Nature of Supervision^ Exercised: General supervision 
Equipment Used : • - 

Microfiche reader/printer and duplicator 
, Photocopying machine * • V 

.' * ~ Computer terminal ' • :^ . • ■ •"■ • 

■-. • . * * *■ *■ • 

Qualifications required: . - 

■ . . ' . f ^ 

A. ; Formal Education: ° 
. Accredited degree in Library Science 

J5. Experience: , * 

■ Over two yearis professional experience ' ' b ■ 

C. Manual Skill: * 
^ Ability to enter searches accurately at key-board terminal. 

. D. Other: * . \ 

Knowledge of French an asset; good judgment, tact, analytical ability. 
Knowledge of highly: specialized educational literature and materials 
essential* 
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APPENDIX Q. Library Assistant 
Position Summary: • J - • • 

| ft yi«>T- gc-noyai mipAnrtglon. handles • correspondence; types letters, •» . 

reports, etc; duplicates articles and fiche; maintain* files of records 
and -correspondence; Nioes billing and invoicing; compiles simple statistics 
for the project and N the search service, codes data for statistical analysis. 

Duties and Responsibilities: * 

Receives in-coming telephone calls > answering queries when possible 

Types a?Ll correspondence, reports, other items. or materials as . 
necessary, that are associated with the project^and search service. 

a. .* 

Duplicates journal articles, fiche, etc., as required for the 
project and search service. 

Handles all in-coming and out-going mail associated with the 
project and search service. ' • ■ v . 

Maintains records and correspondence files of the project - and v ^ 
search service. . ~ 

-Responsible for all billing and invoicing: associated with the 
search service. \V < 
Codes data for statistical analysis. 

Compiles simple statistics and budgetary records associated with 
the project and search service.* - 



5Z 


1. 


35Z 
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2. 




3. 


10Z 


A. 
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5. 


10Z- 


6. 


10Z 


7. 


I0Z 


8. 



Auxililiarv Duties : 

Attends meetings : of project staff and performs^other duties as 
required. - 

Work Complexities: 

A. Choice of -Action: ^ 

Exercises judgment in sorting mail, referring telephone calls. Sets 
work priorities for self. • 

B. Consequence, of Error; 

1 . Inaccurate billing or invoicing can, result in lost revenue , bad 
public relations. C * 

2. Delay in duplicating can result in damage to optimum turn-around 
time of service. f 

3. Inaccurate record-keeping and coding can result in annoyance to 
• , project staff and lessen the reliability of the data Required / 

^%or analysis. • { v 

C. Difficulty:' ' 

1. Newness of service requires patience and tolerance until routines 
are established. ' 

2. Sharing physical facilties with library staff requires tact, 1 , 
flexibility. , ■ ■ , 
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D, Contacts 



^^equent contact with iibrary and project staff and with search 
service user*S. Occasional contact with staff in Depf . of Educational 
~Admini3tration ■— ~ : — 



Supervision Received* — 

General supervision received from Librarian II and Principal Investigators 

a 

Equipment Used ; , 

Calculator / 
Microfiche duplicator 
Microfiche reader /printer 
Photocopying machine 
Typewriter 

Qualifications Required : 

A. Formal Education: 

High School graduation 



■ . ■ ■ : ■ ,. - • ■ \ 



Experience: 

One year as a Library Assistant I, or related experience preferred. 

<;• Manual Skill: 

Accurate typing essential f 

J). Othert 

Good judgment, accuracy, alertness for detail, conscientiousness, 
ability to withstand routine, .^ility to work under limited super- 
vision; ?: 



} 



} 
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EHIC, Information, and Change in Education: 
Selected Annotated Bibliography 



Part A. Change and Innovation: ^Theory and Practice 



> Pari ERIC and the Schools 
Part C. Issue's and Concerns in Information Handling 
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PART A: CHANGE AND INNOVATION: THEORY AND PRACTICE 



Benni s, Warren Robert v "" The" Piann i ng of 
■" Change , 2nd ed. Toronto: Holt, Rinehart, and Winston, 1969. ^ " 

■' ;.' • ** 

; Consisting of a Ijnost f I fty articles, thisvolume presents a valuable, 
overview of many aspects of the change process. It not only traces the 
historical roots of p lanned change, but also presents ^currently accepted 
theories and strategies for implementing change. .It Is one of the few 
texts that treats resistance, conf f ict w and ethical dilemmas and goals/ 
f' involved in planning change. The emphasis Is on using transactional, 
problem-solving techniques developed by organization development experts 
Sheldon Davis and Richard Beckhard. * 

Carlson, Richard Q. Adoption of Educatlgna I 1 innovations . Eugene, Ore.: >r 
s ; Urfiverslty of Oregonr, Center for the Advanced Study of Educational 
Administration, 1967.* 

Carlson is concerned with explaining the. factors that account for the 
* i varying rates of adoption and diffusion of educational innovations. His 
unit of analysis is the superintendent of the school system and the 
innovation he traces is rrtodern math. By exam? ni ng the characteristics 
. *" - of the adopting &nit, the source^ of information^ and. the position of 
the adopting unit in the social structure of similar units, he found 
that superintendents who adopted modern math early had greater Involvement 
tf in social networks and a higher position in the status structure. 
They tend to seek advice more often from those higher than themselves 
in the 'status* structure. Early adopters tend to be younger, have higher 
professional ratings, have shorter tenure In their present positions. 
^ New practices that were characterized by high relative advantage,; 

compatibi I ity, diylslbl I ity, and commun icabl I ity and low complexity had 
■ faster rates of diffusion. The rate of diffusion for new math Was 
. five Y ears * * 7 ' • ■ 

■*• • *••',* 

Christie, Samue! C , and Scri bner, Jay *D; \^ "A Social System Ana lysis of "., . 
Innovation in Sixteen School Districts." "Paper presented at the * 
conference of. the American Educational Research Association, Los Angeles, 
California, February 1 969. (EB 029 369) . 

. In the belief that the school -commun ity should be viewed as a s6j^ial 
system, the authors collected data from 65 .board /members, 16 superin- 
tendents, 16 principals, and 358 teachers in 16 southeVn California 
school districts. They developed two scales to measure the dependent 
variable, rate of; adoption of educational Innovations^ the first to 
■ 4 ^measure district adoption, .the second to. measure individual teacher 
adoption. Independent variables included were, among others, - 
. cosmopol iteness, opinion, leadership on Innovation, communication " " 
patterns./ Multiple regression analysis was. .used to obtain" results from 
data collected; p : * 
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Farr, Richard. "Knowledge Linkers and. the Flow of -Educational Information, 
An Occasional Pqper for ERIC at Stanford. Stanford', Calif..: Stanford 



University, ERIC' Clearinghouse on Educational Media and Technology, 1969. 



„ _ 

"The linking institution of tomorrow is ho longer a single Individual, 

ni> longer a salesman with a commercial ax to grind, no longer a nonentity 

- in the educational information flow system. Educational linkers are 

being calle<fr v upon to shape the educational future of this^ country. Why? 

Because they are really .the" only ones in a position to do It. Thev are 

':■ central to the; flow of information, in touch with those who need to know 

and'+hose who can .tell them. A pinking institution Is not to be a ' 

passive midpoint in the flow of Educational knowledge,, but rather an ^ 

active force in sending to, and seeking -£rom al I those who make up the 

educational communfty." (p v 7). Farr presents a general discussion 

s of the need for and role of the "knowledqe I i nker" in education. 

% - - • " w ■ . - . 

y : - - • . " s '. . ; * \ ; - ■ , . : ... p • • , 

Fllegel, Frederick C.,and Kivlirt, Joseph E. "Attributes of Innovations , 
as Factors In Diffusion." American Journal of Sociology 72 (November 
1966): 235-48. 

In attemp-King to generalize about the extent to -which perceived 
attributes of innovations affect their adoption, the authors co I I ected 
data on attributes of thirty-three farm practices from 229 farmers. 
They found that those innovations which were perceived as being the f most 
rewarding and involving least risk were accepted soonest; high costs, 
didjnbt represent a deterrent. Little emphasiswas placed by farmers / 
on the potential cost recovery or. savings in time but reliability in 
producing desired results repeatedly was an important Dositivjs factor • 
of the innovative practices under- consideration. 

Havelqtf% Ronald G. , et« a I . Plann? ng for I nnovation through Dissemination 

and Uti I izaf ion of Knowledqe . Ann Arbor, Mich.: University of Michfgan, 

v Institute for Social Research, Center for Research on Utilization of 
Scientific Knowledge, 1973. 

* /■ "This report" provi des a* framework for understanding the processes of* 
Innovation, dissemination^ and knowledge util ization, and it reviews 
■ ■' +he Relevant literature' j n educat I on and ; other , f i e I ds ot p r ract i ce wj th i n 
this framework. Di semination andTu^ is : wewed as : 'a ■ 

transfer of messages by vacjous media between resource systems' and users. 
Major sections alia lyze character i sties of yindi vidua Is and organizations 
'which Inhibit or faci I Itatq th ts transfer The orocess is intern reted - 
at four level s; the indiVi'dua I , -/the i nterpersona I , ^rhe organization, , 
, and th& social system. Additional chapters deal s^cl f Ica4 I y" Kith> 

SDeclalized 'linking' roles " between resource* and user, types c^^ssages, 
typ.es of media, and phase models of the process." (Summary; 




0 
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Havelock groups D & U models .used- by other authors according to 
their major viewpoints: CI) Research, Development, and- Off fusion 
models, (2), Social Interaction models, .and (3) Problem Solving models. 
He takes features from each of these to develop his "linkage model", > 
He exp f a i ns ~D ~ST IT phenomena^ using" seven" facto rs : I Tn kagey s t ruct u re , 
ooenness, capacity, reward, proximity, synergy. He &qjncludes by 
suggest? no needed research on D J U. x 

■ ■ ' J " ' . • ' ■ ■ • ' /. . 

Katz,* Elihu. "The Social Itinerary of Technical Change." The Planning 
. of Change . 2nd ed. Edited by Warren G. Bennis, Kenneth D. Benne, 
-and Robert Chin. Toronto: Holt, Rinehart, and-Winston, 1969. . * 

;. ' • . ; 'i . . " - 

The landmark study by Bryce Ryan and NeaT Gross, "The Diffusion of 
.Hybrid Seed Corn in Two Iowa Communities," Rura I Sociology 8 (March 
1943) : 15.-24, Is compare* to the. studies bv EAJhu Katz and Herbert Menzel 
•tracing the^adopt-ion of a new drug. r The time of Initial adopt i on , s the 
decisions That i nf I uenced adoption, and the soci a I structure o'f the* 
adopters were traced. The- findings of bot-h studies show that the rate 
df diffusion is represented by an -S-curve; that informal sources r 
"legitimate" decisions to adopt;, that early adopters read more, travel 
more, have higher incomes,* are better educated, and ar*fe' younger than 
late adopters of innovations. x 

■ • -f . ' ' - . ' 

Katz, E.; Levin, M. L. ; and Hamilton, H; "Traditions of .Research on the 

Dif fusion ofv I nnovat ion." American Sociological .Review 28 (1963) : 237-52. 

.^Defining diffusion as "the acceptance over time of some specific item- 
an idea of practice, by i ndi\^Uiua I s, groups or other adopting units., 
linked to specific channels df communication, to a social structure, 
and to a given system of values, or culture," the authors present an 
-overview of the contributions made to each of these elements i n the 
j diffusion process by studies in anthropology, education, sociology«bf mass 
conmuni cat-ion, rural sociology, public health, and marketing. They 
suggest th^'t "time" Ts the key* factor in diffusion research and draw 
\;dT§T^ctions between first use and continued use of an innovation. They 
'il-jjarl scr'po I nt to the lafck of 'research that examines all the elements of their 
definition and enumerate avenues of research they consider, to be in need 
of exploration. ■ • ; \>; \*. ; 

Marcum, R. Laverne. Organizational CJ imate and the" Adopt ion of Educational 
Innovation;. Washington, D.C. : Department of Health, Education, and 

Welfare, Bureau of Research, 1968. (ED 023 158)-. 

•- _ • ■ - ^ ■ . 

In a study of thi rty , school s in five western states, if was found that 
the'most innovative schools had open cl imates, higher expenditures per 
studenf; younger, more numerous, less experienced staff. Includes a 
copy of the Organisational CI imate Description Ouestionnai re developed 
,by Andrew/^: Ha-I pin ^nd Don. B. Croff. 
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JO Marker, Gerald , and Mehfinger, Howard D. Report of the Social Studies 
Field Agent Training Program* Fi^ 1 Report. Blpomington, Ind.: 
/ Indiana University Foundation, 1972. (ED 076 463) • 

^fhe primary goal of the program was to test the feasibility of empjoying 
specially trained social studies teachers to increase the rate of 

• diffusion of innovations In their subject area. The recruitment and 
training program are described. The personalities of the fie Id agents, 

,. the degree of I oca I -commitment to change, and folj^ow-up support for 
field agents are Identified as key variabiles in tlie^success of inside 
change agents. V . . 

11 Michigan. State Board of Education. A Study of the Diffusion Process of 

VocatTona I Education I nnovations . Lansing, Mich.: State Board of^ 
Education, 1967. (ED Oil 297). c — % 

In. attemotrng t<? shorten the time lag between' research discoveries and* 
adoption of innovations in vocational education, 600 Michigan high school 
were surveyed. Each of four vocational areas-agricultural, business, 
home economics, and trade and industrial education-was .asked to identify 
fivie innovative practices. Data was collected on the time of adoption 
of .these practices, sources that influenced adoption, visitation and 
communication networks, practices bbserved, in other schools. 
■ Questionnaires are Included, \ * 

- • " - - ' . . . . . / ' • 

12 Miles, Matthew B. 1 "Educational Innovation: The Nature of the Problem." .'• ". 

l*nnovat-ioA~in Education . Edited by Matthew B. Miles. New York: - . 
Teachers Col lege Press, "1964. - - 

In th e fi rst "chapter of this anthology of readings, the author describes 3 
the climate for innovation in the.rfcJ.S. in the sixties, provides ' 
causative factors, under I i ries the need for further enquiry. He reviews 
a wide range of innovations, explains strategies used to promote the 
adopt ran of innovations and mentions as yet unexplored areas of the field 
in need of research. He identifies four stages which occur prior to the 
adoption of an innovation by a target system: design (of innovation) , 
awareness- interest, eva I uati on, and trial . . The strategy for adopting 
an innovation may be initiated bv the target system, or by an outside 
[. , system,: and, may I nvo I. ye the usk of. ex-i sting- structures or the creation 
v of new ones. He gives examples of each of the/possible. sixteen . ; 
.combinations that result from these variables. . : 

13 " Mi les, Matthew B. , ed. Innovation in Education . New York: Teachers Col lege 

Press, 1964. ^ \. - . j' ' 

^ ^ Resulting fronp a seminar series held during I960 at the Horace Mann- 
i/:- \. Lincoln Institute, this voljur^ presents an overview of the title's topic 

by some of the major contributors to the j^*ld: Rogers, Mort, Carlson, 
, Miles. Divided into three- parts, it presents case studies, research 

and theories,^ arid characteristic features of the American educational % 
r.: : 'r/\'- : .sys'tem--as^'fhey- relate to educational. * innovation. ' * : ; 
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.M4. Miller, Donald P. * Planned Change in Education , Washington, D.C. : Department 
of Health! Educati.orv and Welfare, 1968. (ED 022 250). 

^ This docjj^ent presents a sypth^^s-of ideas^from various, a reasj^f the L 

behavioral, sciences to prepa^^^^caf r Ional planners In California to 
e.ffect planned change*. ^The ^affect I nq' the change process" 

such as the need for to! fa^or^^^^^^forts, "between researchers, teachers, 
and school administrators; th^^^P^wfetJ^^a f f eel* an individual's degree 
of /involvement in" the" proc^s§ pf'«£dqpf jfbtvl .e.^CfT sVnse of security, 
w (2) dominant vaJue^ C3.) mental 1 ' abT I Yty -artd conceptual skill, (4) social 

status, (5) cosmopb I i-teness, (6) .op I rfion-Jeactersh ip ability; the process 
of adoption »itsel f from awareness, ^ rn+ere^t aad; eva+tjation, through to 
trial and ;adoption; the rote of the change a *agent ; the Importance of group 
dynamics and communication , "networks are all' out Lined and drawn together 
in a model for implementation 1 of innovations. i'n educational practice. 
-. ■' ' ' 1 : ' • • v • 

15 * Mort, Paul R. "Studies in Educational I nnbvalf ion From. the". Institute of 

Administrative Research: AYv Overview." Innovation in Education . Edf 
* • Jjy^ Matthew B. Miles. New York:' Teachers Co H-ege- Press, {1,964. 

. Mort and his students at the Institute of Administrative Research at ^ 
Columbia carried out over 200 studies* between "fche 1 92(0 T s and late 
I950 r s on the adaptability of public school systems" and the adaptabi I ity 
process. Among .their now-famous findings were that^ typicaf ly, fifty 
years elapse between the recognition of a need by a school' sVstem and 
the adoption "Of a means of meet i pa t^hat need. * The diffusion process 
takes' another fifty years.. Innovative school systems were shown to 
have supDortive administrators, highly trained teachers, high community 
•expectations and financial support.* D. H.' Ross in ' Administration for 
\ '". Adaotabi I Ity (New York: Metropolitan School Study Counci I , 1958) ~- 
analyzed most of. the studies and organized them, into those, tjjat described 
what hapoened in the adaptation process, those that'treated the influences 
on the adaptabi I ity of 'school systems, and those .that described the; 
characteristics of the adapters. ■ * /- 




16 Mort, Paul R.,, and Cornell, Francis G. .Adaptability of Public School . > 

.Systems. JMew-York: - Columbia University, Teachers Co.l lege, I93B; V - 

t , * - - r ......... , 

".^ A school system's "adaptabi Hty" is "defined as. its capacity' to reject . 
'* otiimoded practices and to. ta^e- on :yew ones -to meet, i.ts/new needs. Its 
'abi i.ity to do- this* Fs governed by the nature of ^the ^nvl ronment, the 
structure of the school svstem, and the agencies arrd methods used in 
the adaptation process.' Mort develops hypotheses that relate to each 
of these areas. This volume Is one of the earliest to formu late, and 
insist on the importance of hosts of variables In examining the 
adoption process and as such traced the oath that much later research 
was to fol low, A major portion of the work deals with the positive 
relation of average expenditure Der pupil to th'e degree of adaptability 
of the school svstem. . „ 



National- Seminar on the Diffusion of New . 1 nstruct tonal Materials and Practices?* * 
Racine, Wisconsin, June 1-3, 1973 . Boulder, Colo. : Social Science *** 
Education Consortium, 1975. (ED 083 III - 083 116). 

•ft . 

This, series of ^working papers offers general observations on the 
diffusion process for developers, users, participants in dissemination 
and^mp lementation activities; describes characteristics of subject 
matters and developers that tend to encourage or Inhibit ideas or 
products; identifies characteristics of schools that discourage or 
encourage the introduction and use of new Ideas; and out.llnes the role 
of communication mechanisms within the diffusion system that facilitate 
orvhinder diffusion* of Innovations. 

Rogers, Everett M. "What Are Innovators Like?" Seminar on Change Processes 
' in the Pub Tic Schools . Eugene, Ore.: University of Oregon, Center 

fpr the Advanced Study of Educational Administration, 1965. 

* » 

"Innovators are the first members of "a social system to adopt new' 
ideas." (p. 55). That is, innovators are among the first 2.5 per cent 
to adopt a new practice. Genera My,., they tend to be young, have 
relatively high social status, rely on impersonal and : cosmopol Tte sources 
".of " i nf ormation* They travel widely, exert opinion leadership, and sec 
themselves (and' are seen by their peers) as deviants. Innovative school 
systems are usually found in affluent areas where the community desires 
an A effective education for its children. 'Systems mav encourage change* 
through choosing teachers with the desired spcia I characteristics^ by 
exposing teachers to educational innovations at conferences and work- 
shops, by utilizing change, agents. 

• '. ' ■ " ' * 

Rogers, Everett M., and Shoemaker, F. Floyd. Communication of Innovations: 

A Cross-Cultural Approach . 2nd ed. New York: Free Press, 1-97 1. ' 

The authors have analyzed and synthesized oyer 1,500 research .studies 
on, the adoption and diffusion of Innovations. They summarize the various 
research traditions and then treat selected major concents fountf. in 
the literature: the innovation-decision process, H the relation of N . 
attributes of innovations to their rate of adoption, adopter categories, 
opinion leadership, the characteristics and role of the change agent, - 
communication .channels. They point ocil^-the shortcomings 9f existing 
studies and calf attention to areas requiring further research.. The 
generalizations contained in the book are listed at the end with examples 
of empirical diffusion studies that do and do not support, each. 
Complete citations' are given for the many studies. 
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Watson, Goodwin. "Resistance to Change." The Planning of Change . 2nd ed. 
Edited by Warren G.Bennis, Kenneth D. Benne, and Robert Chrn. Toronto: 
Holt, Rinehart, and Winston, 1969. . 

Having "described "the "tvpTTcal" ITfe-cycle d ~~ 
Identifies those forces in the individual and in the organization that 
constitute resistance to change. He views men as possessing an Inner 
stabilizing force that acts as a regu I a. + ory mechanism. "Habft, primacy, 
selective perception and retention, dependence, superego, self -distrust, 
insecurity and regression provide further obstacles to change in the 
individual. Social systems deve I otr^cor respond icig resistance traits. 
.Reasons for resistance Include conformity to norms, systemic and cultural 
coherence, vested interests, the sacrosanct, and reject ion ^of "outsiders" 
He concludes that to be successful I y adopted change must be supported 
by top officials; it must be seen as necessary, ^non-threateninq. 
Participants must hpve opportunities for feedback and revision, and they 
must have trust and confidence in each other. 

Woods, Thomas ,E. The Administration of Educational Innovation - Eugene, 

Ore.: University of .Oregon, Bureau of Educational Research and Service, 
J 967. <BD 067*768). . - , ' ■ . 

In orden f or the superintendent of schools to implement effective 
programs of. change, he must be .aware, of the various phenomena associated 
with change processes.* Woods. summarizes findings of behavioral science 
treating characteristics of Innovation." adoption, and diffusion. 
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PART B: ERIC AND THE SCHOOLS 



Bruett7~Mary "J67"~ r 

(INFORMS ) , Activities Manual:" Operational and Promotional . Des Moines,- 
Iowa: Iowa State Department of Public instruction, September 1972. 
m (ED 069 305). 

Operated by the Iowa State Department o/ Public ^Instruction, Project 
INFORMS is an ERIC information retrieval service for the state l s school 
districts. This manual was compi led to' assist project personnel in 
Identifying their roles,* in gaining familiarity with the operational * 
requirements af the project, in devising effective promotional activities, 
Examples of eva I uat Ion and. field agent reports are included. 



Cutter, Virginia M. Dissemination Pol Teles, • Procedure, and Programs of 
KNne State Education Agencies^ Washington, D.C., January 1974. 
TED~090 967). ^ ■ . r ., - ' 

<The state programs concerned with- bri ngTng ERI O to the schools on a 
significant scale are the following: J) The Florida Department, of ^ 
Education has a set of the ERIC fiche, JO, 000 indexed resumes of journal 
articles, 6,000 books, newspaper clippings, and subscriptions to 300 
journals Ijsted In CIJE<^ it serves DOE staff., teachers .and administrators 
.of schopl districts-, jun I or col I ege^ and state universities through a 
network of sixty-six satellite centers Jocqted^In colleges, universities 
and area technica I -vocationa t centers that each has a trained information 
consultant, ;a li-mited collection of ^ER I Cliche,'' and readers. FERIC 
resoonds to about 150 searches a month/^nd supplies/In addition to 
bibliographic information, microfiche; hardcopy (on loan), and cooies 
of articles. 2) In I I Mnois , the Superintendent of Public Instruction 
has. establ I shed f i ve instructiona I materials centers for special 
education .funded by state and federal' grafts. The central IMC in the 
0SPI has, among other materia I s, ' an ERIC cot lection, and .responds to 
approximately ten requests a week sending ERIC hardcopy, . books, and 
abstracts. 3) The ;lowa Network for Obtaining Resource Materia I s for 
School's (Project INFORMS) is federally funded, but housed in and 
\V administered by the^ state's Department of Publ ic Instruction., Services/ 
are provided through volunteer field agents In eleven of the state T s 
Regional Education Service Agencies. Resources available to teachers 
through INFORMS include documents in the ERIC system, articles J isted . 
in CUE, packets -from the .series Putting Research info.Educatrona! 
Practice (PREP), names of consultants, lists of promising educational 
< practices In Iowa. Over a thousand reauests were answered In 1972 
ranging, from computer searches to location of 'an article. The" field 
agents, appointed by the county superintendent and trained in their 
I inking ,ro I es by the Far West Laboratory fol Iow-ud reauests to assist 
the patron to make maximum use of the packet and to determine the 
effecti veness v of the^ response. They serve as contacts for focal school 
people, negotiate the information question, forward^it to central 
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INFORMS at the Department of Public Instruction and provide follow-up.' 
Although the agents at first regarded their role-as a burden, they now 
-.view themselves as a service. 4) Montana subscribes to 'the search 

se^vjj:^ of._CooperatJ.ve_Serv_Lces. 

Thefmain^sers are administrative staff of the. Department of Public. 
Instruction and even this use Is limited. The service is not advertized 
since^it is felt that lack of information linkers^ to negotiate the 
. question with the user and to specify the need to BOCS severely reduces 
the4jsefufness. fc of s the information received. 5) New York State y s^use of 
ERIC varies with the. specific program of each of the forty-seven Boards 



of Cboperatlye Educational Services; (BOCES). BOCES are agencies. beaded 
by a district superintendent which function as change agents for the 
State Education Department. The Education Department has also created 
art Educational Programs ancT Studies Information Service (EPS IS) located 
near the education section of the State Library. EPS IS 'provides I oca I 
educators and BOCES staffs with an ERIC search service using the 
"Biomedical System! 1 of the State University of New York. ..The extension 
of the service was being planned when this. report was compiled. 

. 6) North k Carol i na T s Research and Information Center provides ERIC* ' 
. computer searches at a fee. of $20 to $25 for local school officials and 

state department of education personnel.." For local education 'agencies 
the IJIC will reproduce journal articles,; send up to twenty microfiche 
j v at no charge, develop a bibMography, and include the name of a person ; 

-who may. supply additional information. 7) Pennsy I van?a T s infer/nation 
needs are met throucjh Research and Information Services for Education 
(RISE). This statewide project serves- the state's tv/enty^-nine inter- 
mediate units by training er staff member of the IU as a resource 
utilization specia list '(RUS) who transmits requests for information 
from schools to RISE, si^polies fiche readers where necessary , and 
delivers and interprets information packets. In answer to reauests, 
RISE supplies an ERIC bibUograohy and original documents' in hardcopy v 
or microf iche. 

24 Have lock, Mary (X,.and Have lock, Ronald G. - Project L INKER. #?Case Study of 
.- *■ the Merrimack Education Center. Local Information Network of Knowledge, 
for Educational Renewal (LINKER). Final Report . Chelmsford, Mass, : 
Merrimack Education Center, 1974. ^CED 094 728). - . . : " 




The Merrimack Education Center was Established "to bridge the gap between 
—J theory and practice In education^" Founded In 1968, it serves twenty 

school districts with 85,000 student^ and 6,000 ^taf^f. It provides in- 
service' training on specific topids for educators, -sponsors conferences, ■ 
acts as a broker in providing consultants/for school boards. " These and 
its other programs ^re supported by an Information service that relies, 
heavily on the ERIC library.. The Center sel Is yearly' subscriptions to 
boards i+rfft include a viewer, 200 microfiche, and sets of Research in 
Education . This method allows the board to. enter, the cost for the 
service as one line item in its library ^udaet without any capital 
outlay. From having jts Initial budaet of $85,000 totally funded bv the 
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federal government, the Center has, largely because of these^ERIC - 
subscriptions and othbr products and services, .evolved to a position 
where the school boards pay 50% of it$ current $300,000 annua I budget . 
Budget, for information activit ies'speci f ica! ly amounts to $68,000 per 
annum>— of^-wh i ch- $ 1 8> 000;-*i s-pa i d for -by- local -users I n-add Hi on to -three- 
part time field agents, .there are twenty "gatekeepers" (prlncioal, , 
teacher, or librarian) trained by the agent In the use, of information . 
systems, ERIC In particular./ the gatekeepers translate^ teacher requests 
far* Information into requests to the Center for specific documents or. 
for computer searches on specific descriptors. The, Center uses the 
Mitre CorDoration for automated. ERIC searches'. Cost of subscriptions^ 
are $275 for new subscriptions^ 1 50 for renewals,\$485 to other schools 
and organizations outside' the/project . The authors describe in detal V • 
the linkage operation and how it conforms to a'nd differs from Havefock T s 
Other wrrti ngs. "• - # 

. Related document ED 094 729 by Richard ■ Lavi.n,' fexecut I ve~D! rector 
of the Merrimack Education Center describes his concept of "linkage". 

Have lock, Ronald "G. , et" al . Educational Innovation in the United States . . 

* 2 vols. Ann Arbor, Mich. : Uni versity of Michigan, "Center for^ Research ; 
\ '■■ on Uti (ization of Scientific Information, 1973. (ED 091 -865) ■ 

As part of a study to determine the f easibl I ity of doi ng aSational- 
survey of innovations in schools, the authors attempted to assess- the us£ 
of externa i and interna! resources whn"ch might be used in the promoting, - 
adopting, or .imo I ementi no of innovations* 'Other teachers were cited 
by 44£ of the 315 representative school districts wh i |e EPIC was used 
by 9%. The research da+a was co fleeted In 1970-71. Among the 
barriers to innovations that are identified are linkage', structure, 
opennessV capacity , reward, and synergy.' 

Lindsay, Kenneth P. Utah's Piiot State Dissemination P rogram. Final Report s 
, Satt Lake City, Utah-: State Board of . Education, May 1973. (ED 078 858) . ' 

tj • ~ 

The Utah Technical Assistance. Project through the Technical Assistance 
Reference Center .performed alrnost 1,800 batch ERIQ, Searches in. .1972," 
circulated 2,800 f iche, dupl icated 219 fiche and disseminated information 
through 52 district agents to local educators. The aaents were chosen 
by loca I .st5fiool "^system superintendents, traln^jd by Center staff in • 
conjunction with th£ Far West Laboratory (the EPIC Training package is 
described, by. ED 069 327) to take requests .front their - local educators 
and relay them to the Center ;and to evaluate the Center's services through 
case studies/' The est rWted budget for the project for 1973 was* - 
5246,95-5. Case studies'" questionnaire's, /evaluations are included* : „ 



• \ 



218 



27 ^ McCfeary, Wi I liam H* Information Retrieva L Center .of the Northern Colorado 

Educational Board of Coooerative Services. -Final Report, F.Y. 
; Boulder, Colo.: Information Retrieva I -Center,. August 1972.. (ED 067 134) 

" " The Northern Colorado Educational Board of ;Cooperati ve Services (NCEBOCS) 

Information Retrieval "Center provides computerized ERIC searches to 
Colorado, Utah, Oregon, South Dakota, Washington, Wyoming, Idaho, Noisth 
l \ ' ' Dakota, Kansas and Montana'. Addition to ERIC bibliographies and 

> fiche, the Center provides jackets of Educational Topics (PET), a Catalog 
of Computerized Searches ((iftj-l:,. Current Awareness Profiles (CAP), and 
% " Searches in Depth (SID). Center searches its own ERIC tapes m 

response to approximately I ; 000 , requests for automated searches received, 
per month. September, October, and November are the busiest months and 
educational administrators are the heaviest users (superintendents, 
principals, consultants) fol lowed by teachers. Researchers and graduate 
students requested a tenth as many searches. Volume at the Center grew 
from i ,435 ERIC requests fij I ed ki 1970 to 6,5=35 filled in 1972- Of 
the evaluations returned, 56* of users f el/ the computerized abstracts 
were relevant to their ^requests, 73& 'of users receiving manua I searches 
% : • . <' were satisfied. The author concludes that the key to successful 

retrieval is for the retrieva I staff to thorough I y understand the request 
\ - - and to interpret It as precisely as possible. Includes workshop agendas, 
training materials for users. 

28 Research and Information Services for Education. "RISE." King of Prussia, , 

Pa.> 1.974. (Mimeoqrapfied ) 

Formed- in 1972 and funded by state and federal agencies, RISE is an 
educational information' agency sponsored jointly by the Montgomery 
County Intermediate Unit and the Pennsylvania Department of Education. 
Among other types . of information, It orovides on-line computer searches 
of- the ERIC data base free to schools of the MCIU «nd to the Bureau of 
Planning and Evaluation of the Pennsylvania Department of Education. 
Of .the twenty-nine Intermediate Units in the state, RISE has trained 
Resource -Uti I tzat ion Spec! a I ists who act as i ntermed iaries I n twenty-f I ve 
Costs for searches depend on tybe of search- and category of user but . : . 
$25 is average.^ JournaJ articles are supplied at I0£ per copied page^ 
and microfiche duplicated at 25C per^fiche. 

29 Robinson, Erika L. An Ana ly sis of the Impact of the Research Utilization " 

Project on Pr.incipa ts.. r7 Atti tudes and on the Use of Information Services 
bv Teachers- and Other Field Personnel i,n~~l 6 Target Elementary Schools 
of~the District of Columbia . Washinqton, D.C. : Office of Planning, 
Research and Evaluation, Departments -of Research and Eva I uat ion, 1973. 
(€0,086 177). . * - : 

. The -Research I information Center of the District of Col umbia Rub l ie -j 
'.; Schools col lects and disseminates information Fncluding jERIC on 

educational research and innovations. A project usinq aaen.ts to : increase" 
awareness. of the cente-r^.s services was undertaken. In ana tyzing; the . 
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impact of RUP, several hypotheses were confirmed: • that target schools." 
requested more searches than non-target schools; that use of .educational . 
T* extension agents increases participation and satisfaction of users; 

'. * -that more searches, were performed during the project period than before* * * 
•; it*.' The author recommends the extension agent concept "as a model for. 
•ftie development' of a system-wide /dlssemi nation system.", -J> . 

30 Schalock, H. Del, et a I . The Oregon Studies in EdufcationaT Research, ^ / ^. 

Development, Pi f fusion and Eva I uatf on . 5 vols. Monmouth, Ore.: Oregon 
State System of Higher Education, Teaching Research Divfsion, 1972- 
(ED -066 837 - 066 844). : . 

Because of the" Pack of information on development, dif iision, and . 
evaluation activities as they related to education, and because of the 
. scare ity.^pf cfeta Regarding the best methods for training Dersohnel ..for v 

these areas, fhe USOE in T970 sponsored the Oregon Studies. Vo4-tjme L 
. consists 1 ^ of a Summary Report; Volume II: The Literature of Educational. 
R DD^ A. E , (not available on fiche); Volume III: Conceptua I Frameworks . 
' \ for "Viewing Educational ROD & E; Volume IV: Prof i I es of Exemplary 

Projects' in Educational RDD & E; Volume V: A* Methodology for the Study 
of Educational RDD & E. . Volume IV, Case Prof IJe No. 18 present? an 
overview of that part of EPIC from January 1970 to November 1972 
operated by Leasco in the context of a model diffusion project. 

31 ' . Sieber, Sam D. ; Lou I s, Karen-Seashore; Metzger, Loya .. The Use- of- 

Educati ona I Know! edge. 2 vols. New York: Columbia University, Bureau 
of ^Applied Social Research ,. 1 972^ (ED 065, 739 - 065 740).* 

The Pilot State Dissemination program described Was the. first large-, 
.scale attempt to bring the resources of ERIC to local teachers and 
administrators../ Three state's with "mainly rural and smaM town popti I ati-ons 
were chosen. Two extension .agents, were uti I ized ful l-.time iin two of v . "V 
the states, and three in the third to hel.p clients, in target areas . "* 
i dent! fy^fbelr needs, to relay their needs; to the retrieval center, to \ 
- . re+urn'and interpret Information to the c( ierit, and to. "consider its 

appl Icabi li ty -arid steps^ for -pessible, Imblementation^ Volume I .described 
-■ - the aba I s of the program, the -rolies; qfV+h0 -fleld/ageht'Jn- educa.t ipn,. : 

the information retrieval process; organizational, issues, tra.ming/*of * 
project staf f, outcomes of the>p rbg^ 
j / ■ is composed/of the case studies of the thr^e states... .Extensive'.. • ^ : : 
appendices Include numerous ~.examp les : of forms used for r data^cdllect ion.- - 
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32 Timbte, M./ and Coombs, D. An interactive Information Retrieval System: 

Case Stud I fes on the Use of Dialog to Search the ERIC Document File . 
Stanford , *Ca I Tf . r Stanford University, Institute for" Communications 
Research, 1969. /ED 034 431). J ' 

Describes user evaluation study of on- 1 ine computer searching "of ERfrC 
y document f He us^inq Dialog; describes^DFa log, search procedure, subject 
. ^ , . population, operating procedures; presents results of nine, case studies 
discussing system usefulness, ease of use, advantages of interacting 
v ^ with search; presents resulfs of nineteen later evaluations by visitors 
\ . to the system; discusses -further uses of system over a period 1 of sfeverak 
months; appendix. Includes evaluation materfals, protocols. 

33 ^Wilder, Dolores J., ed. Tennessee I nformat ion Retrieval and Dissemination . 

System for Vocationa l" Education . Final Report ; (July 1 , 1 970-Juhe 3D, 
. 1 97 1 ) . - Knoxv i Me, Tenn .- : Tennessee Occupational Research and 
. Development Coordinating Unit, I97f. (ED 056 215). 

The. Tennessee Research Co-ordinating Unit (a Unit of the State Division 
/of Vocat I ona I -Technical Education and the Col lege of Education, 
/ University of Tennessee) searches theTERIC tapes using .the "Ouery" 
fc . . program. The service may be used by anyone in . the state working in the 
field of education. : Users are. provi ded with a computer-printout 
bibliography and microfiche of original documents at I0<t per copy. 
Each search costs $15. The RCU &stab I ished thirteen "Regional Resource 
Centers" in 1970 which- contain partial ERIC.fi les, a reader-printer, 
and; Indexes. They serve 'as the" contact point between the RCU at 
■ KnoxyT'lte and the local useYv During an' October + o June nine-month 
period, 4,526 microfiche titles were-di sseminated to 575 users* . . 
, The total budget for one year was $38," 25.0* A user-sat isf action 

questionnaire and its results* are included as are -workshop agendas and ; , 
r - ' ' i n forma t ion mate rials. " : „ - ./^ v 1 

34 Wol fy W. C. , J r. , and Fiori no, A. J.°. hr> * A Study of Educat tona l Knowl edge 

Diffusion and Utrl izatidn . Amherst, MasiTT" University of 'Massachusetts, 
: : 1972. . (ED 06.1" 772) . .. * ' • . \ 

- The authors feel that there is a need for ''baseline data pertaining to 

the educational knowledge di f fusion and utilization process^ 11 -'To supply 
this information, their study examined the extent to which 600 teachers, m 
supervisors and administrators,* artd teacher* educators have adopted, - 
j planned to adopt or failed to adopt innovations within a one year 

y period; the influences of recognized diffusion agents upbn the adoption 

. of innovations; "characteristics of selected target -audiences in .relation 

to the adoption of innovations; relationships between five stages of 
innovation adoption reported, by Rogers, Lionberger, and others, and the 
adoption process described by randomly selected educators. ^ ERIC was 
one of the innovations studied. Interview Questionnaires are included 1 , 
and. criteria of .computer proo-rams to analyze rtpe data .are*: descri bed 
briefly. ' . :. - ^ \' \ ■'' 




234 



X 



* -u ; . • ^ 221 

PART C: ISSUES AND CONCERNS IN . INFORMATION HANDLING " 



35 Borman, Lorraine, and Mittman, Benjamin.' "Interactive Search of Bib I lographlc 

Dat? Bases in- an Academic Environment."- Journal of the American Society 
... * for Information Science 23 (May-June t 972) : 164-71 ~ ' ~ ~ ~~~ 

The authors; re late their experiences 'in attempt i ng +o~ attract appropri ate ''' 
research faculty and students of , Northwestern Untyersity to use on-line . 
data bases in physics and astronomy. Faculty refused to use the system 
without a librarian to negotiate their requests and even then their 
use was JTumma I . Student use, on ^the other hand, was enthusiastic. - 4 
.The authors attri bate this di fference to the classroom* environment T y . 
"which encourages the student to learn and be receptive to new processes . 
. , white the research worker's success is 'dependent on his previously 

" - estab I i shed modes of behavior. • . • . ■ B 

36 Brickley, Richard R.,. and Tnohos.kT, Carolyn V. The Evaluation of Educational .* ' 

Information Centers . TM : Report 34. Princeton, N.J .ERIC Clearing- 
-house on Tests, Measurement, & Evaluation, I974J X 

• . ••• '■ • ... - . ■ '■ • ••• ■ •• . x / 

The authors, disti nguish between different, kinds of • I nformat ion services . - 

• and the issues involved in evaluating information activities. They 
. d-i fferenti ate between the various comoonent parts of' an educational 

. ^ infonjriat^ oh center-riiser needs, J nformat I on resources < data- bases),* 

questipn negotiation (search and retrieval ), impact and uti I ization, , 
cost ef f dfcti veness-and .analyze recent evaluative "efforts In these areias, ' 
A copy" of the RIST^l t terature search -evaluation is I nclude^. 

- ■ * - * - . ■ ••'*•..--'•• : ' ♦ ' . ■ ■•, \ : , yv " : ■ . 

37 \ Christ,. C. jW. ., • Jr. " -"Microfiche: A Study of User Attitudes end Reading; 

Ha^s';" ', Journa l, of the Amer ican Society for I nformat iorr Science 23 . 
V" < January-February -1 972) : - 30-35. < - 7 ; ~~~ ~ ■ ■ : -\ / " 

• >■. ■ " . '■ ■■ • v , • • ■ ' " • . - . * 

The- Libraries and Information System ^Center of Bel T Telephone 

a La Bpratbries. conducted a study to determine whetner their scientists 

and eng i rreers ; v wou Id accept microfiche as an alternative to p^oer for 

distribution of . their technical reports and to determine whether thf s V 

change li5 format effected the reading habl+s of this group. At. the end 

of a . .nj ne month period; 35% of the partict piants agreed to^ont in ue 

N - receiving their reports on fiche. ' They cited suita£> i 1 i ty for scanning 

and ease of' storage as factors contributing to their positive response. 

Lack of readers and poorsquality of fiche and readers. were criticisms . 

most often cited. The reading habits of the recipients underwent ■ - 

/subtle changes as a result of receiving their' reports in fiche; format: 

they tended to "batch" or gather fiche' to scan several at a sitting ■ .: 

. and they re.ad mp^e at the office and less *at* home. 
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38 CleverHon^ C. W. "User"Eva luation'of Information Retrieval Systems."* 

Journal , of tjocumentatton 30 (June l974V^A2p-80 # . : ■ 

' It is the author 1 s; content i on that mos+^eva I uat Tons done of i nf ormat ion 4 
V' . retrieval systems -are strongly management-oriented* They are concerned 
with methods of improving performance -and reducing costs but rarely 
. consider the real needs of the users "and their degrj§p of satisfaction t 
wi+h, the service they arre receiving, therefore the criteria of •» 
precision. an3 recat I which measure the performance of ;a system jnust be 
replaced by measures t bat determine the.yalue or usefulness of the • 
sys tern to .the user. These should determine the extent to which users. 1 

- needs are being- met* by the syste*n, L ;.t.he reasons they are not being met, 
the. cost-effect iveness of-^^aT^he's^made by users themselves or by users 
via intehmekljaries,'. the infect on the ra+e. of usage of charging for - ' 
searches. He . proposes a jf iye-stage model that tfe fe-els can provide 
data that wi I I be rfe levant- in tackl inq these concerns. ^ 

39 Cooper, Michael D. "A Cost Model for Eva I uat ing Information Retrieval 

Systems Journal of the American Society for I nformatron Scfence 23 
(September-October 1972): 306-12. . ' : 

A mathemat f icaj mddel was developed to. provide a method of comparing , ^ 
costs between different informat ion retrieval system^.* The model 
divides the total costs of - the retrieval operation info those incurred 
: by the user and those_ incurred by the system. For each of these - — . 

1 components, p re-search, search^ and post-search* act ivi ties costs are 
- analyzed. The system al lows sebarate cost- a I locations to the user and - 
. ; to. the -system and suggests that there is a "tradeoff between the 
t degree of generality or specif icrty ; required in the search and the , 

. - . cost and benef it of. .conducting it." . " 

40^ • Deats, Tom. . "Moving and Using • I n formation. 17 Teachers College Record 15 

(February 1974): 383-93. : A : * 

The author feels that ERIC 1 s fai fure to be widely used by American^ ".; 
.T educatorSj^has been largely (ajid wrongly) a ttr i buteftj -to a fai lure in 
commun icat ion. " The basic under ly ing, assumption (equaj ly incorrect) 
r. has' been .that increased-, know! edge of the information System ^mong, * 

educators .wou I d mean i ts v grfeater u*ti ' ization. The author be! i eves \. 
:> that the problem is not^one. of ^creating greater awareness but of failing.. 

- to. "take into account the ."ways in. which oeo'ple' in" a given community 

ta I k about what is* important to them in that community context." The *' f\ 
x educator must' feel the system is useful and relevant to him-a slow 

orocess not Nkely to be i.nf I uenced .bv^mass Dromotiona I campa igns. The 
v . ERIC people must start with the user's perceptions /and needs and not 
, attempt to tfnrust a finished, product upon the consumer. \ 
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41 DeGennaro, Richard. "Provi ding- Bib I tographic Services From Machine-Readable 
Data Bases - The Library's Role." Journal of Library Automation 6 
(December (973): 215-22. 



. The t i brari es of the future wi l l act as i nformat ipn brokers meeting the 
needs of the i r patrons through access to central ly maintained-,- commercial l*y 

. available data bases. Contrary to the pop.u I a 4 r\ view at this time, they 
wi 1 1 not subscri be to the data tapes themselves for^they w] I I recognize 
that the costs involved are not limited to the subscription fee for tapes 
but^invoiye computer programs to manipulate and access the tapes,, and 
administrative and marketing costs to acquire users. The costs , for ' mm 
providing on- 1 ine access to bibl iographic information wi 1 1, have to be 

: borne by the user since i t is 1 un I i ke I y that I i brary budgets will increase 
and some mechanism for controlling un limited usage , wi ll be necessary. 
Whi fe special units within . I iBraries^may be necessary to handle /Fhese 
new data services at the present tame, Tn .the future access wi I I be 
provi ded as- a norma I service by reference I ibrarians. 



42 . Elman, Stanley A. "Cost 
Literature Searching, 




ison of Manual and On-Line Computerized 
cial Libraries 66 (January 1975); 12-18. 



The formula 



S-QTAL 



= (T x 



C SUM } 



.+ P was devised to represent the total- 



cost of completing an on- 



line literature search. The total cost As 



arrived at by. multiplying the op-line time in minutes, T, times 
sum of all costs per minute of operation (including, comput^r-conneqt 

<-up charges, and terminal leasing) and 



time, labor, telephone hook- 
adding the cost, P, of off-line 
of 66 computer-aided I rterature s< 
I nf prmat i on retri eva I system open 
Library was $47.00. The average^ 
required for the automated sean 
search,' 22 hours . 



inted citations. The average cost 
irches via the Dialog on-line 
L ed .at Lockheed-Ca \ i forn ia Company 
lanua I - search cost $250.00. . Time 
averaged 45 minutes, for the manual 



Products and Services;. 4 vols., 



43 \ Fry, Bernard M. Eva I uation Study, of ER^ 

Bloomington, J nd. : Indiana University Graduate Library School , 
• r - .(ED 060*922 - 060 926). — ' . . 



I 972 « 



A . large-sca le eya l,iiat ion of the ERI C system was made over an eighteen 
month period by faculty and graduate students at I ndiana /University. 
Data from 2,500 qyes^ionna iT'es supplemented by interviews were 
collected and analyzed. It was shown that users judged the ERIC system 
very favorab ly~; nine out of ten users/ fe 1 1 they -obta i ned. information 
they would not have obta i ned otherwise i seven out of ten said the . „ 
information obtained resulted in improvements in the way they did things; ^ 
more than hajf reported that ERIC had prevented them fronr duo Heating 
efforts. Persons for usi,nq.ERIC publications included keeping abreast". 
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' In a field, research projects, program improvement, assignments and term 

papers^ and curricu I urn development. Educational practitioners constituted 
the largest single group of users. Most users learnt about ERIC through . 
. v classroom instruction and colleagues. / * 

■ . * * * m ■ 

44 Katzer, Jeffrey. "The Development of a Semantic ; Differential to Assess 
" • Users' Attitudes Towards An On-Lt.ne Interactive Reference Retrieval 
■ System."' Journal of the American Society for Information Science 23 
CMarch-April 1972): 122-28. \ ~~ _ • v 

. "A semantic differential is an instrument used to measure attitudes. 

\+ consists of a series of bipolar adjective scales on which the ■. *v , 
respondent reacts^ Such a scale was developed to measure users 1 
reactions and attitudes to an experimental i nteracti ve retrieva I system 
v . % providing free searches to Psycho log! ca I Abstracts through SUPARS 
(Syracuse^ University Psychol ogica I Abstracts Petri eva I # -Service) . , 
Seventy-oh^ users completed 19 adjective scales describing 20 concepts. 
"The correlations among the scales were factor analyzed. Three 
i ndependent dimensions were identified. Factor 1 was labeled 'evaluative- 
specific' apd accounted for over 23% of the tota I variance. • Factor II r 
was called 'desirability 1 ; it accounted for over of the -tota I 
variance. And, Factor III; entitjed 'enormity' accounted for over \Q% 
of the total .variance." (p. J22).* A replication of this study is 
described in JASIS 24 (July-August 1 973) : 307-308. ■ 

' ' v ' ..-V v;. •;■.'/'' ' * 

4f5 Kuehl, Philrp G. , "Marketing Persoectives for 'ERIC-Like' Information 

Systems." Journal of the American Society for Information Science 23 
. (November-December 1972) : 359-64. 

"ER!C-Like u information systems conform to the business functions that 
... are characteristic of private enterprise: they generate revenue, -they 

produce and market a product . Therefore ^ ~ to maximize their effectivei- 
" ness, the author feels these, systems shoul d recognize that they' are in 

the market? ng f ield and uti I ize basic marketing concepts to Increase* 
- * their effectiveness. , They should therefore d irect their efforts toward 
identifying user wants -and needs and developing products that\satisfy . 
these needs. . The product developed out , of user suggestions would then 
be much more readi I y marketable since it Wpu'Td virtual ly sel l itself • 
'Specif ic marketing techniques that, the i nforma.tr on scientist should 
be famU iar with are consumer behavior research, channels of < 
' . distri bution, organ izat ion* theory, and I market .segmecstati on ana lys i s. 




Lancaster, F/ fy. "MEDLARS: Report" on the^fcvaluation of Its Operating 
Ef f icierfpy." American Documentation 20 (Apr? I 1969): 1 19-42. 

A comprehensive eva I uat ion of the Medical Literature "Analysis and 
Retrieval System (MEDLARS) operated by the Nationa I Library of Medicine 
was conducted In 1966-67. The search requests submitted by scientists 
and doctors over a twelve month period were analyzed tb evaluate the 
operating efficiency of MEDLARS/ The requirements of r the users were 
assumed to be the coverage of "the useful 1 i terature on -a given; topic 
indexed In the system, , the abi I ity of the system to ret rfeve documents, 
lie*, its "recall power", the ability of the system to yieMd orrly 
relevant documents, i.e. its "precision power", the time reqOi red to 
respond to a request, the format of the search results* and the effort 
the user had to expend for a successful result* The findings indicated 
that they system was operating at 57.7% recal ! and 50.4$ precision. 
The sources of fai lure -accounting tor these low rates were found to be 
lack of specificity and exhausttvity of the ' indexing language, searching 
„ errors due to use of inappropriate terms or defective search logic, 
deficiencies owing to inadequately formulated requests by the user. 
Among the suggestions for improvement are. that the user submit a 
statement in narrative form-not in what he "believes to be search 
strategy-of what he is looking for and the purpose of the search. * 

Lancaster, F. W. , and Climenson, W. D. "Eva I uat i ng .the Economic Efficiency 
of. a Document Retrieval System,." Journal of Documentation 24 . 
(^arch: 1968): I6-4G. N . V 

The authors separate the criteria used to. measure the efficiency of. a 
retrieval system into those that are user-oriented and those that are' 
management-oriented. Those characteristics that signify the operating 
efficiency of the system to the user are its coverage, usability, 
recall, precision, response, presentation, and user effort required. 
These factors mustb.e weighed agai nst the "need of management; for 
economic efficiency-. The break-even points,, trade-off factors, and 
dtmfnishing returns are considered" in relation to the various component 
parts of the whole retrieval system: acquisition, Indexing, .Index 
language, searching, and equipment. . In the final, analysis, however, 
the authors feel that the question to answer Is not ^whether a system 
is operating efficiently but whether it is 'worthwhi le. They suggest 
that this worth may be arrived at by measuring what users are witting 
to pay for it and what beneficial, influence it has on decision-making. 
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48 Marron, Harvey, and Sul 1 ivan, /Patr-icia. "Information Dissemination ~In 

. Educations A Status Report/' College and Research Libraries 52 
(July 1971): 286-94/ / 

.'. ^ The authors give an overview of ^fhe quantity of information produced Jn 
■V ;.; education and the efforfs^made to control and disseminate it. They n> 

treat both primary pub l/lcations and secondary services , as wel l as 
reviews and summaries of the \ iterature, on-going research and develop- » 
. men t, and new techniques available. They chart major indexing and 
abstracting services 6f special interest to educators, and list their 
fields caf interest, availability, coverage, cost, and source. 

49 Mathies, M. Lorrai ne, arid Watson, Peter G. ' Compute r-Based Reference - Service. 

Chicago: American Library Association, 1973. <- - 

Intended as a text/ on the potentia l of "computers for reference ^ .■•;-.».- 
/ .librarians, this volume uses ERIC as an example of a model nnformat ion 
. '.. v system. . The flow? of information through Research in Education, 

document processing, vocabulary development. and control , and indexing 

methods used by .{ERIC are all, described. The^princip les and strategies 
• "of computer searching using binary numeration and Boolean logic are/ 

outlined.. Examples of prof lie forms, typical searches and other 

machine readable data bases are included. 

50 Pais ley /"Wi I ! iam. 1 f improving a Field-based "ERIC-Like" Information System." 
jf . Journal Of the American Society for Information Science 22 (November- i 
* December 1971): 399-408. '■ \ : 

The ERIC system is criticized because It has not succeeded infringing 
- the educational knowledge base to the* practitioner. To overcome this 
fault, the author suggests that the concept of an^ educational extension 
agent be implemented and, that continuing education programs be conducted, 
, He recommends that ERIC abandon the short abstract format of Research 
. V" in Education in favor of a longer abstract on +he APA mode! that would 



act as a document surrogate; that microfiche be abandoned in favor of 
full-size dhotocoples of the or Tqina I document, and "that information 
analysis products compiled on an ad hoc basis give way to a continuing 
review and; synthesis -of current documents. He fee Is that the 
information ainalysis activities of the :cJ earlnghouses should b"e separated 
from thS on-site user services and that a I I " document-processl ng operations 
should be centralized rather than geographical lv dispersed. . " 
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51 . Penner,. Rudolph J. "The Practice. of Charging Users for Information Services: 

A State of the Art Report." Journaj'.of* the American Society for 
Information Science 21 (January-February 1970): 67-74^ r 7"~ 

' Charging users for Informail^n services has not yet become a .common " 
practice among I i braries. The ^attitudes, of society may part I y account . 
for; this situation but the inabi 1 ity of \ ibraries to arrive at a sound 
basis for, charges "is "glso a significant factor. - The author...surveypd- : V . 
the literature for articles on charging systems and cost-accounting 
for in-ho&se information services. .Since he found "very I i+tle he next 
tried to di scover "artlc I es ^on any fcnown costs for providing information. 
''\ He constructed a ^chronological table,. 1959-1968, Mst-rng twenty-two 
v seoarate information-related operations, their costs as reported by . 
the i r authors, and the source, where they were reported. He concludes . " 
tha^rcenters are rel uctant to" report the it costs and charges, that. 
I ibrar ian's either, do ..not know/ or do not want to know the cbsts of their 
r systems, that large operating centers "arfe most capable of running 
v .* -their operations Iri a businessl ike "manner. • 

• A - : " . - . 

52 - Stern, Louis W.; Craiq, C. Samuel ; -LaGre£a, Anthony J.; and Lazorick, 

Gerald J. "Promotion. of Information Services: An Evaluation of. 
. Alternative Approaches.":. Journal of the American Society for r 
Information Science 24 (Mav-June 1975): 171-79. " ~ - \ 

Three promotional programs to gain users for the selective dissemination, 
of information. (SDI ) services of the Mechanized Information Center at 
"Ohio State University were designed and -eva I uated. Methods used were 
opinion leadership, "blitz", and teleohone solicitation. For each 
method data was collected .to show the leve,1pg£ market penetration 
"achieved; the level of user satisfaction generated; the i nf I uenee of 
the program components employed (letter, telephone call, brochure, 
1 . visit); the cpst/ef f ect i veness . Results showed that- "b I itz" and ' 

telephone sol I citation programs' achieved greatest market penetration; 
there were no significant effects of program on user satisfaction; 
■J a personal visit from the information special 1st' was the most effective . 
r\tt converting a r potential user, into an actual one; the "b I Itz" Drograrn " 
was the .cheapest followed closely by the telephone solicitation. 
; Tables showing details of . costs for each method and the instrument . 
administered to measure user sat Is fact ion -are included. 

^ * - .*■ ■ 

53 Summit, Roger K~. "DIALOG and the* User - An Evaluation of the User Interface. 

With A~ Major On-Line Retrieval System." Interactive Bib I lographic / 
Search: The', User/Computer ' I nterface . - . Edited by. Donald E. Walker. 
* Montvale, N.J.; AFIPS Press, 19.71. ' 

DIALOG -refers to the on-line information retrieval system developed .V 
by. the Lockheed Palo -Alto Research Laboratory.. Original I v used to . - 
\ '*' retrieve NASA documents i-n 1967, it has evolved, into one of the two^ 
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most widely used systems to retr^fceye ERIC materia Us', the other being 
System Development Corporation 1 ^ Orbit [I. Summit describes the 
design character} sties of DIALOG ,-bv following *the basic steps of a 
computer* search. He concludes by presenting the results of an extensive 
evaluati6n of the system. The DI ALOG features that , imp resseid users 
most We re : its SDeed ami its atxil rty. to suggest other relevant areas oK 
information or alternate way£ of finding information origina l>*£ sought j 

Tayl or Robert S." "Quest ion-Negot fat ion and Information Seeking ir^r • * 
.Libraries." Col lege and Research Libraries (May~ 1968): I — II.-- 

The informati orv seeker dievelops his need for information through four 



levels: first, he feels a vague and unexpressed 
i.nformat iorv, "the visceral need;", secpnd, he has 
of -hi s need, "the conscious need; " th i rd, ' he can 
rat iona K statement, "the forma I i zed -need; 9 last, 
quests on ? ~!n terms of. the information, a vai- Lab I e, ' 



but real need for 
a mental description 
make a concrete, 
he can recast his • • 
f fhe compromised need." 



-It is the ski Mr.of . the information soecialist to filter What the 
inaui rer communicates in order to help him to find the information he 
really needs.— In this negotiation process the specialist must deter- 
mine the limits and structure of the subject; the motivation, . 
objective. $nd background of the inquirer; the'- relationship of the 
inquiry description to the -file organization; and the kind^of answer 
the inquirer will* accept. Only through this del icate I nterp+a^ can 
the true needs of the inaui rer be determined and met. 



Ware^ Glenn 0. T, A General Statistical Model for Estimating Future Demc'd 
Levels of Data-Base Uti I i Nation With in an. I nformat ion Retrieval 
Organization." ? Journal of the American Society for- fhformatfon Science 
24 (J-uly-August 1 973) : 260-64 . : ~~ ~ ^~ r 

: Y A general statistical model -was developed that ;would predict the growth 
patterns of data .ba^se uti 1 izatlon and estimate future . levels of- defnand.. „ . 
The model was tested against data gathered at the University of 
Georgia's information .retrieval" service on the number oi users requesting 
current awareness search requests against seventeen separate data *- 
. "t>ases over a twenty-four month period. The model is y = J3 CI — _ e"^_) . 

where y is the number of users of a data base at tine t, and cc and jS are 
" parameters to be estimated. The a u+hor r s claimed 99% accuracy has 

impl ications for. admi-nlstrators of retrieval; services regarding . 
. personnel > software, hardware requT remdnts.. 
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Wood, D. N. "User .Studies: A "Review of- the Literature from 1966 to 1970." 
, As I ? b Proceedings 23 (January 1971): 11-23. • T V , 



In reviewing sixty-nine user g^uTies on the information gathering 
abits of scientists, engineers-,' and socia I scientists, Wood' concludes 
^ \ that scientists select the information source they f I nd. easiest to use . 
T\ m (usually their own- collect ion) more often than the ohe with. the 

^greatest potentia l : va I ue; t.hat i nforma I ,communi cation. Iketween scientists 
t.s of great importance and means must b'e developed ..to exploit it; . . j \ 
• that users are reluctant to use indexes and abstracts but welcome- 

instruction; that abstracts • serve the purpose" of keeping the researcher 
up to date without resorting to primary sources; that I1br7ari.es of 
the future will seJ I their services. 7 ^ 

Wright, Kieth. "Social Science 1 nformatiorjf Characteristics- with Particular 
- Reference to th§ Jiducationa I Resource^' Information Center (ERIC)*" 
+ Journal of th'e American Society for . 1 nformation x Science 24 (May-June • 
v / I $73): 1-^264. ... ~ . — : . .- *?-.\ 



The l iterature of the social sciences Ts Wi.'de.ly '.dispensed in many 
books and journals and across numerous disciplines. Its terminology 
is i I f-defined, contains much' technical jargon, uses everyday- '.wood's 
with -varied meanings* - These character \ sties create problems for 
-indexing, thesaurus- cohstructrxm, and i nformati on .retrieva l / Education 
buffers from al I these problems common to t'he social scfences. Wright 
describes the. components of the ERIC system, places ERIC in the context 
of social science information, and enumerates criticisms that "have ' 
been 7 Kevel led against ERIC: the problems of decentralization which 
do not allow for uniform practices or standards, the lack of control 
over the. quality of the information abstracted, the i nadequacy. of the 
indexing vocabu lary and the. thesaurus structure; He presents a 
survey of the . attempts to organize socia I, science -information and lists 
most, of the major, studies;. .done of the ERIC, system. 
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